Nov 09 01:58:13 user nova-compute[75438]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75438) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 01:58:13 user nova-compute[75438]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75438) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 01:58:13 user nova-compute[75438]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75438) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 09 01:58:13 user nova-compute[75438]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 09 01:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 01:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 01:58:13 user nova-compute[75438]: INFO nova.virt.driver [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 09 01:58:14 user nova-compute[75438]: INFO nova.compute.provider_config [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Acquiring lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Acquired lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Releasing lock "singleton_lock" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Full set of CONF: {{(pid=75438) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ******************************************************************************** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Configuration options gathered from: {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ================================================================================ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] allow_resize_to_same_host      = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] arq_binding_timeout            = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] backdoor_port                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] backdoor_socket                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] block_device_allocate_retries  = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] block_device_allocate_retries_interval = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cert                           = self.pem {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute_monitors               = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] config_dir                     = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] config_drive_format            = iso9660 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] config_source                  = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] console_host                   = user {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] control_exchange               = nova {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cpu_allocation_ratio           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] daemon                         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] debug                          = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] default_access_ip_network_name = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] default_availability_zone      = nova {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] default_ephemeral_format       = ext4 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] default_green_pool_size        = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] default_schedule_zone          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] disk_allocation_ratio          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] enable_new_services            = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] enabled_ssl_apis               = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] flat_injected                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] force_config_drive             = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] force_raw_images               = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] graceful_shutdown_timeout      = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] heal_instance_info_cache_interval = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] host                           = user {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_build_timeout         = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_delete_interval       = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_name_template         = instance-%08x {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_usage_audit           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_usage_audit_period    = month {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] internal_service_availability_zone = internal {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] key                            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] live_migration_retry_count     = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_config_append              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_dir                        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_file                       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_options                    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_rotate_interval            = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_rotate_interval_type       = days {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] log_rotation_type              = none {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] long_rpc_timeout               = 1800 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] max_concurrent_builds          = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] max_concurrent_live_migrations = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] max_concurrent_snapshots       = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] max_local_block_devices        = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] max_logfile_count              = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] max_logfile_size_mb            = 200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] maximum_instance_delete_attempts = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metadata_listen                = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metadata_listen_port           = 8775 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metadata_workers               = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] migrate_max_retries            = -1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] mkisofs_cmd                    = genisoimage {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] my_ip                          = 10.0.0.210 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] network_allocate_retries       = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] osapi_compute_listen_port      = 8774 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] osapi_compute_unique_server_name_scope =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] osapi_compute_workers          = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] password_length                = 12 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] periodic_enable                = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] periodic_fuzzy_delay           = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] pointer_model                  = ps2mouse {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] preallocate_images             = none {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] publish_errors                 = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] pybasedir                      = /opt/stack/nova {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ram_allocation_ratio           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rate_limit_burst               = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rate_limit_except_level        = CRITICAL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rate_limit_interval            = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reboot_timeout                 = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reclaim_instance_interval      = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] record                         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reimage_timeout_per_gb         = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] report_interval                = 120 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rescue_timeout                 = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reserved_host_cpus             = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reserved_host_disk_mb          = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reserved_host_memory_mb        = 512 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] reserved_huge_pages            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] resize_confirm_window          = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] resize_fs_using_block_device   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] resume_guests_state_on_host_boot = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rpc_response_timeout           = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] run_external_periodic_tasks    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] running_deleted_instance_action = reap {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] running_deleted_instance_timeout = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler_instance_sync_interval = 120 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_down_time              = 720 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] servicegroup_driver            = db {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] shelved_offload_time           = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] shelved_poll_interval          = 3600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] shutdown_timeout               = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] source_is_ipv6                 = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ssl_only                       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] state_path                     = /opt/stack/data/nova {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] sync_power_state_interval      = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] sync_power_state_pool_size     = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] syslog_log_facility            = LOG_USER {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] tempdir                        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] timeout_nbd                    = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] transport_url                  = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] update_resources_interval      = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_cow_images                 = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_eventlog                   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_journal                    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_json                       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_rootwrap_daemon            = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_stderr                     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] use_syslog                     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vcpu_pin_set                   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plugging_is_fatal          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plugging_timeout           = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] virt_mkfs                      = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] volume_usage_poll_interval     = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] watch_log_file                 = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] web                            = /usr/share/spice-html5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.auth_strategy              = keystone {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.compute_link_prefix        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.dhcp_domain                = novalocal {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.enable_instance_password   = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.glance_link_prefix         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.instance_list_per_project_cells = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.list_records_by_skipping_down_cells = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.local_metadata_per_cell    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.max_limit                  = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.metadata_cache_expiration  = 15 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.neutron_default_tenant_id  = default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.use_forwarded_for          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.use_neutron_default_nets   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_dynamic_targets = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_jsonfile_path   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.backend_argument         = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.config_prefix            = cache.oslo {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.dead_timeout             = 60.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.debug_cache_backend      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.enable_retry_client      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.enable_socket_keepalive  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.enabled                  = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.expiration_time          = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_dead_retry      = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_password        =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_sasl_enabled    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.memcache_username        =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.proxies                  = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.retry_attempts           = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.retry_delay              = 0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.socket_keepalive_count   = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.socket_keepalive_idle    = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.socket_keepalive_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.tls_allowed_ciphers      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.tls_cafile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.tls_certfile             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.tls_enabled              = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cache.tls_keyfile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.auth_section            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.auth_type               = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.cafile                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.certfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.collect_timing          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.cross_az_attach         = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.debug                   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.endpoint_template       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.http_retries            = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.insecure                = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.keyfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.os_region_name          = RegionOne {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.split_loggers           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cinder.timeout                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.cpu_dedicated_set      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.cpu_shared_set         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.image_type_exclude_list = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.resource_provider_association_refresh = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.shutdown_retry_interval = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] conductor.workers              = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] console.allowed_origins        = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] console.ssl_ciphers            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] console.ssl_minimum_version    = default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] consoleauth.token_ttl          = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.cafile                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.certfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.collect_timing          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.connect_retries         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.connect_retry_delay     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.endpoint_override       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.insecure                = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.keyfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.max_version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.min_version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.region_name             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.service_name            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.service_type            = accelerator {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.split_loggers           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.status_code_retries     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.timeout                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] cyborg.version                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.backend               = sqlalchemy {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.connection            = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.connection_debug      = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.connection_parameters =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.connection_recycle_time = 3600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.connection_trace      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.db_inc_retry_interval = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.db_max_retries        = 20 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.db_max_retry_interval = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.db_retry_interval     = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.max_overflow          = 50 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.max_pool_size         = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.max_retries           = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.pool_timeout          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.retry_interval        = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.slave_connection      = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] database.sqlite_synchronous    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.backend           = sqlalchemy {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.connection        = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.connection_debug  = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.connection_parameters =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.connection_recycle_time = 3600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.connection_trace  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.db_inc_retry_interval = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.db_max_retries    = 20 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.db_max_retry_interval = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.db_retry_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.max_overflow      = 50 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.max_pool_size     = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.max_retries       = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.pool_timeout      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.retry_interval    = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.slave_connection  = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] api_database.sqlite_synchronous = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] devices.enabled_mdev_types     = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ephemeral_storage_encryption.enabled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.api_servers             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.cafile                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.certfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.collect_timing          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.connect_retries         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.connect_retry_delay     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.debug                   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.default_trusted_certificate_ids = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.enable_certificate_validation = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.enable_rbd_download     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.endpoint_override       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.insecure                = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.keyfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.max_version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.min_version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.num_retries             = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.rbd_ceph_conf           =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.rbd_connect_timeout     = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.rbd_pool                =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.rbd_user                =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.region_name             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.service_name            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.service_type            = image {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.split_loggers           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.status_code_retries     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.timeout                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.verify_glance_signatures = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] glance.version                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] guestfs.debug                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.config_drive_cdrom      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.config_drive_inject_password = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.enable_remotefx         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.instances_path_share    =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.limit_cpu_features      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.use_multipath_io        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.vswitch_name            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] mks.enabled                    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] image_cache.manager_interval   = 2400 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] image_cache.precache_concurrency = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] image_cache.remove_unused_base_images = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] image_cache.subdirectory_name  = _base {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.api_max_retries         = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.api_retry_interval      = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.auth_section            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.auth_type               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.cafile                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.certfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.collect_timing          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.conductor_group         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.connect_retries         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.connect_retry_delay     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.endpoint_override       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.insecure                = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.keyfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.max_version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.min_version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.peer_list               = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.region_name             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.serial_console_state_timeout = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.service_name            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.service_type            = baremetal {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.split_loggers           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.status_code_retries     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.timeout                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ironic.version                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] key_manager.fixed_key          = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.barbican_api_version  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.barbican_endpoint     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.barbican_endpoint_type = public {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.barbican_region_name  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.cafile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.certfile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.collect_timing        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.insecure              = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.keyfile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.number_of_retries     = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.retry_delay           = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.send_service_user_token = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.split_loggers         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.timeout               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.verify_ssl            = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican.verify_ssl_path       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.auth_section = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.auth_type = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.cafile   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.certfile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.collect_timing = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.insecure = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.keyfile  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.split_loggers = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] barbican_service_user.timeout  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.approle_role_id          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.approle_secret_id        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.cafile                   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.certfile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.collect_timing           = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.insecure                 = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.keyfile                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.kv_mountpoint            = secret {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.kv_path                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.kv_version               = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.namespace                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.root_token_id            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.split_loggers            = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.ssl_ca_crt_file          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.timeout                  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.use_ssl                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.auth_section          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.auth_type             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.cafile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.certfile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.collect_timing        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.connect_retries       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.connect_retry_delay   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.endpoint_override     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.insecure              = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.keyfile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.max_version           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.min_version           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.region_name           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.service_name          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.service_type          = identity {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.split_loggers         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.status_code_retries   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.timeout               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] keystone.version               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.connection_uri         =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_mode               = custom {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: WARNING oslo_config.cfg [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_power_governor_high = performance {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_power_management   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.device_detach_attempts = 8 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.device_detach_timeout  = 20 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.disk_cachemodes        = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.disk_prefix            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.enabled_perf_events    = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.file_backed_memory     = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.gid_maps               = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.hw_disk_discard        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.hw_machine_type        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_rbd_pool        = rbd {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_type            = default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.images_volume_group    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.inject_key             = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.inject_partition       = -2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.inject_password        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.iscsi_iface            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.iser_use_multipath     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_downtime = 500 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_inbound_addr = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_scheme  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_timeout_action = abort {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_tunnelled = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: WARNING oslo_config.cfg [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 09 01:58:14 user nova-compute[75438]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 09 01:58:14 user nova-compute[75438]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 09 01:58:14 user nova-compute[75438]: and ``live_migration_inbound_addr`` respectively.
Nov 09 01:58:14 user nova-compute[75438]: ).  Its value may be silently ignored in the future.
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.live_migration_with_native_tls = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.max_queues             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.nfs_mount_options      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.num_pcie_ports         = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.pmem_namespaces        = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.quobyte_client_cfg     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rbd_secret_uuid        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rbd_user               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rescue_image_id        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rescue_kernel_id       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.rx_queue_size          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.smbfs_mount_options    =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.snapshot_compression   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.snapshot_image_format  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.sparse_logical_volumes = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.swtpm_enabled          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.swtpm_group            = tss {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.swtpm_user             = tss {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.sysinfo_serial         = unique {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.tb_cache_size          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.tx_queue_size          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.uid_maps               = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.use_virtio_for_bridges = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.virt_type              = kvm {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.volume_clear           = zero {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.volume_clear_size      = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.volume_use_multipath   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_cache_path   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.auth_section           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.auth_type              = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.cafile                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.certfile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.collect_timing         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.connect_retries        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.connect_retry_delay    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.default_floating_pool  = public {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.endpoint_override      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.extension_sync_interval = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.http_retries           = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.insecure               = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.keyfile                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.max_version            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.min_version            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.ovs_bridge             = br-int {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.physnets               = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.region_name            = RegionOne {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.service_metadata_proxy = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.service_name           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.service_type           = network {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.split_loggers          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.status_code_retries    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.timeout                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] neutron.version                = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] notifications.bdms_in_notifications = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] notifications.default_level    = INFO {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] notifications.notification_format = unversioned {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] notifications.notify_on_state_change = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] pci.alias                      = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] pci.device_spec                = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] pci.report_in_placement        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.auth_section         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.auth_type            = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.cafile               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.certfile             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.collect_timing       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.connect_retries      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.connect_retry_delay  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.default_domain_id    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.default_domain_name  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.domain_id            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.domain_name          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.endpoint_override    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.insecure             = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.keyfile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.max_version          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.min_version          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.password             = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.project_domain_id    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.project_domain_name  = Default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.project_id           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.project_name         = service {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.region_name          = RegionOne {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.service_name         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.service_type         = placement {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.split_loggers        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.status_code_retries  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.system_scope         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.timeout              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.trust_id             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.user_domain_id       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.user_domain_name     = Default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.user_id              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.username             = placement {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] placement.version              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.cores                    = 20 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.count_usage_from_placement = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.injected_file_content_bytes = 10240 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.injected_file_path_length = 255 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.injected_files           = 5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.instances                = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.key_pairs                = 100 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.metadata_items           = 128 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.ram                      = 51200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.recheck_quota            = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.server_group_members     = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] quota.server_groups            = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rdp.enabled                    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.image_metadata_prefilter = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.max_attempts         = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.max_placement_results = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] scheduler.workers              = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.host_subset_size = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.isolated_hosts = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.isolated_images = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.pci_in_placement = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.track_instance_changes = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metrics.required               = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metrics.weight_multiplier      = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] metrics.weight_setting         = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] serial_console.enabled         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] serial_console.port_range      = 10000:20000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] serial_console.serialproxy_port = 6083 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.auth_section      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.auth_type         = password {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.cafile            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.certfile          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.collect_timing    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.insecure          = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.keyfile           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.send_service_user_token = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.split_loggers     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] service_user.timeout           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.agent_enabled            = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.enabled                  = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.html5proxy_port          = 6082 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.image_compression        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.jpeg_compression         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.playback_compression     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.server_listen            = 127.0.0.1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.streaming_mode           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] spice.zlib_compression         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] upgrade_levels.baseapi         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] upgrade_levels.cert            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] upgrade_levels.compute         = auto {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] upgrade_levels.conductor       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] upgrade_levels.scheduler       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.cafile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.certfile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.insecure = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vendordata_dynamic_auth.timeout = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.api_retry_count         = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.ca_file                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.cache_prefix            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.cluster_name            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.connection_pool_size    = 10 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.console_delay_seconds   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.datastore_regex         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.host_ip                 = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.host_password           = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.host_port               = 443 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.host_username           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.insecure                = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.integration_bridge      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.maximum_objects         = 100 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.pbm_default_policy      = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.pbm_enabled             = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.pbm_wsdl_location       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.serial_port_proxy_uri   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.serial_port_service_uri = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.task_poll_interval      = 0.5 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.use_linked_clone        = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.vnc_keymap              = en-us {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.vnc_port                = 5900 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vmware.vnc_port_total          = 10000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.auth_schemes               = ['none'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.enabled                    = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.novncproxy_port            = 6080 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.vencrypt_ca_certs          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.vencrypt_client_cert       = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vnc.vencrypt_client_key        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.disable_rootwrap   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.enable_numa_live_migration = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.libvirt_disable_apic = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.client_socket_timeout     = 900 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.default_pool_size         = 1000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.keep_alive                = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.max_header_line           = 16384 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.ssl_ca_file               = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.ssl_cert_file             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.ssl_key_file              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.tcp_keepidle              = 600 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] zvm.ca_file                    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] zvm.cloud_connector_url        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] zvm.reachable_timeout          = 300 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.enforce_scope      = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.policy_default_rule = default {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.connection_string     = messaging:// {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.enabled               = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.es_doc_type           = notification {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.es_scroll_size        = 10000 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.es_scroll_time        = 2m {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.filter_error_trace    = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.hmac_keys             = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.sentinel_service_name = mymaster {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.socket_timeout        = 0.1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.trace_requests        = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler.trace_sqlalchemy      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler_jaeger.process_tags   = {} {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] profiler_otlp.service_name_prefix = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] remote_debug.host              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] remote_debug.port              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.auth_section        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.auth_type           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.cafile              = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.certfile            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.collect_timing      = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.connect_retries     = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.connect_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.endpoint_id         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.endpoint_override   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.insecure            = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.keyfile             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.max_version         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.min_version         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.region_name         = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.service_name        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.service_type        = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.split_loggers       = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.status_code_retries = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.status_code_retry_delay = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.timeout             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.valid_interfaces    = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_limit.version             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_reports.file_event_handler = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] oslo_reports.log_dir           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_ovs_privileged.group  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] vif_plug_ovs_privileged.user   = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.isolate_vif         = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] os_brick.lock_path             = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] privsep_osbrick.capabilities   = [21] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] privsep_osbrick.group          = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] privsep_osbrick.helper_command = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] privsep_osbrick.user           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] nova_sys_admin.group           = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] nova_sys_admin.helper_command  = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] nova_sys_admin.user            = None {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG oslo_service.service [None req-a9d0759c-aa9a-49a0-86f7-055909a4a7f7 None None] ******************************************************************************** {{(pid=75438) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 09 01:58:14 user nova-compute[75438]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Connecting to libvirt: qemu:///system {{(pid=75438) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fba2c2d3010> {{(pid=75438) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 09 01:58:14 user nova-compute[75438]: libvirt:  error : internal error: could not initialize domain event timer
Nov 09 01:58:14 user nova-compute[75438]: WARNING nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fba2c2d3010> {{(pid=75438) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Starting native event thread {{(pid=75438) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Starting green dispatch thread {{(pid=75438) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Starting connection event dispatch thread {{(pid=75438) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 09 01:58:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Connection event '1' reason 'None'
Nov 09 01:58:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 09 01:58:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.mount [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Initialising _HostMountState generation 0 {{(pid=75438) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 09 01:58:21 user nova-compute[75438]: INFO nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host capabilities <capabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <host>
Nov 09 01:58:21 user nova-compute[75438]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 09 01:58:21 user nova-compute[75438]:     <cpu>
Nov 09 01:58:21 user nova-compute[75438]:       <arch>x86_64</arch>
Nov 09 01:58:21 user nova-compute[75438]:       <model>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <microcode version='1070'/>
Nov 09 01:58:21 user nova-compute[75438]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 09 01:58:21 user nova-compute[75438]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='osxsave'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='invtsc'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='rsba'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature name='skip-l1dfl-vmentry'/>
Nov 09 01:58:21 user nova-compute[75438]:       <pages unit='KiB' size='4'/>
Nov 09 01:58:21 user nova-compute[75438]:       <pages unit='KiB' size='2048'/>
Nov 09 01:58:21 user nova-compute[75438]:     </cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <power_management>
Nov 09 01:58:21 user nova-compute[75438]:       <suspend_mem/>
Nov 09 01:58:21 user nova-compute[75438]:       <suspend_disk/>
Nov 09 01:58:21 user nova-compute[75438]:       <suspend_hybrid/>
Nov 09 01:58:21 user nova-compute[75438]:     </power_management>
Nov 09 01:58:21 user nova-compute[75438]:     <iommu support='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     <migration_features>
Nov 09 01:58:21 user nova-compute[75438]:       <live/>
Nov 09 01:58:21 user nova-compute[75438]:       <uri_transports>
Nov 09 01:58:21 user nova-compute[75438]:         <uri_transport>tcp</uri_transport>
Nov 09 01:58:21 user nova-compute[75438]:         <uri_transport>rdma</uri_transport>
Nov 09 01:58:21 user nova-compute[75438]:       </uri_transports>
Nov 09 01:58:21 user nova-compute[75438]:     </migration_features>
Nov 09 01:58:21 user nova-compute[75438]:     <topology>
Nov 09 01:58:21 user nova-compute[75438]:       <cells num='2'>
Nov 09 01:58:21 user nova-compute[75438]:         <cell id='0'>
Nov 09 01:58:21 user nova-compute[75438]:           <memory unit='KiB'>8189224</memory>
Nov 09 01:58:21 user nova-compute[75438]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 09 01:58:21 user nova-compute[75438]:           <pages unit='KiB' size='2048'>0</pages>
Nov 09 01:58:21 user nova-compute[75438]:           <distances>
Nov 09 01:58:21 user nova-compute[75438]:             <sibling id='0' value='10'/>
Nov 09 01:58:21 user nova-compute[75438]:             <sibling id='1' value='20'/>
Nov 09 01:58:21 user nova-compute[75438]:           </distances>
Nov 09 01:58:21 user nova-compute[75438]:           <cpus num='6'>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 09 01:58:21 user nova-compute[75438]:           </cpus>
Nov 09 01:58:21 user nova-compute[75438]:         </cell>
Nov 09 01:58:21 user nova-compute[75438]:         <cell id='1'>
Nov 09 01:58:21 user nova-compute[75438]:           <memory unit='KiB'>8206460</memory>
Nov 09 01:58:21 user nova-compute[75438]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 09 01:58:21 user nova-compute[75438]:           <pages unit='KiB' size='2048'>0</pages>
Nov 09 01:58:21 user nova-compute[75438]:           <distances>
Nov 09 01:58:21 user nova-compute[75438]:             <sibling id='0' value='20'/>
Nov 09 01:58:21 user nova-compute[75438]:             <sibling id='1' value='10'/>
Nov 09 01:58:21 user nova-compute[75438]:           </distances>
Nov 09 01:58:21 user nova-compute[75438]:           <cpus num='6'>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 09 01:58:21 user nova-compute[75438]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 09 01:58:21 user nova-compute[75438]:           </cpus>
Nov 09 01:58:21 user nova-compute[75438]:         </cell>
Nov 09 01:58:21 user nova-compute[75438]:       </cells>
Nov 09 01:58:21 user nova-compute[75438]:     </topology>
Nov 09 01:58:21 user nova-compute[75438]:     <cache>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 09 01:58:21 user nova-compute[75438]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 09 01:58:21 user nova-compute[75438]:     </cache>
Nov 09 01:58:21 user nova-compute[75438]:     <secmodel>
Nov 09 01:58:21 user nova-compute[75438]:       <model>apparmor</model>
Nov 09 01:58:21 user nova-compute[75438]:       <doi>0</doi>
Nov 09 01:58:21 user nova-compute[75438]:     </secmodel>
Nov 09 01:58:21 user nova-compute[75438]:     <secmodel>
Nov 09 01:58:21 user nova-compute[75438]:       <model>dac</model>
Nov 09 01:58:21 user nova-compute[75438]:       <doi>0</doi>
Nov 09 01:58:21 user nova-compute[75438]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 09 01:58:21 user nova-compute[75438]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 09 01:58:21 user nova-compute[75438]:     </secmodel>
Nov 09 01:58:21 user nova-compute[75438]:   </host>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='alpha'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>clipper</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='armv6l'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>spitz</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>nuri</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>kzm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sx1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>z2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>tosa</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>n810</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>n800</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>terrier</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>midway</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>microbit</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>verdex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>highbank</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>akita</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>connex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>collie</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='armv7l'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>spitz</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>nuri</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>kzm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sx1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>z2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>tosa</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>n810</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>n800</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>terrier</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>midway</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>microbit</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>verdex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>highbank</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>akita</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>connex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>collie</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='aarch64'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>integratorcp</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>borzoi</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>spitz</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>nuri</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>musca-b1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>versatileab</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>kzm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>musca-a</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>smdkc210</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sx1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>z2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>tosa</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>sabrelite</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>realview-eb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>n810</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>n800</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>versatilepb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>terrier</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mainstone</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>midway</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>musicpal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>microbit</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>cubieboard</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>verdex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>netduino2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>raspi3b</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>raspi2b</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>cheetah</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>highbank</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>akita</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>connex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>collie</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>raspi0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <acpi default='on' toggle='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='cris'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='i686'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>x-remote</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>isapc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>microvm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='kvm'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <pae/>
Nov 09 01:58:21 user nova-compute[75438]:       <nonpae/>
Nov 09 01:58:21 user nova-compute[75438]:       <acpi default='on' toggle='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:       <apic default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='m68k'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>an5206</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>q800</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>next-cube</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='microblaze'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='microblazeel'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='mips'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='16'>malta</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='mipsel'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='16'>malta</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='mips64'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='16'>malta</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>pica61</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>magnum</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='mips64el'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='16'>malta</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mipssim</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>pica61</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>magnum</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='16'>boston</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='ppc'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mac99</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>40p</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>taihu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='ppc64'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2048'>powernv9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>taihu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2048'>powernv10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>40p</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mac99</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2048'>powernv8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='ppc64le'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2048'>powernv9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>taihu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2048'>powernv10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ppce500</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>40p</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>pegasos2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>bamboo</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>g3beige</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>mac99</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sam460ex</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>ref405ep</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2048'>powernv8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='riscv32'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='8'>spike</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>opentitan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='5'>sifive_u</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sifive_e</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='8'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='riscv64'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='8'>spike</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='5'>sifive_u</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>shakti_c</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sifive_e</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='8'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='s390x'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='sh4'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>shix</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>r2d</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='sh4eb'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>shix</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>r2d</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='sparc'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>SS-5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>SS-20</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>LX</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>SS-4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>SS-10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>Voyager</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='sparc64'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sun4u</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>niagara</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>sun4v</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='x86_64'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>64</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>x-remote</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='1'>isapc</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>microvm</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='kvm'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <acpi default='on' toggle='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:       <apic default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='xtensa'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>sim</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>kc705</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ml605</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx200</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx60</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]:   <guest>
Nov 09 01:58:21 user nova-compute[75438]:     <os_type>hvm</os_type>
Nov 09 01:58:21 user nova-compute[75438]:     <arch name='xtensaeb'>
Nov 09 01:58:21 user nova-compute[75438]:       <wordsize>32</wordsize>
Nov 09 01:58:21 user nova-compute[75438]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='4'>sim</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>kc705</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ml605</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>virt</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx200</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>lx60</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 09 01:58:21 user nova-compute[75438]:       <domain type='qemu'/>
Nov 09 01:58:21 user nova-compute[75438]:     </arch>
Nov 09 01:58:21 user nova-compute[75438]:     <features>
Nov 09 01:58:21 user nova-compute[75438]:       <cpuselection/>
Nov 09 01:58:21 user nova-compute[75438]:       <deviceboot/>
Nov 09 01:58:21 user nova-compute[75438]:       <disksnapshot default='on' toggle='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     </features>
Nov 09 01:58:21 user nova-compute[75438]:   </guest>
Nov 09 01:58:21 user nova-compute[75438]: </capabilities>
Nov 09 01:58:21 user nova-compute[75438]: 
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 09 01:58:21 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 01:58:21 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:21 user nova-compute[75438]:   <machine>pc-q35-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:   <arch>i686</arch>
Nov 09 01:58:21 user nova-compute[75438]:   <vcpu max='288'/>
Nov 09 01:58:21 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='firmware'/>
Nov 09 01:58:21 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </loader>
Nov 09 01:58:21 user nova-compute[75438]:   </os>
Nov 09 01:58:21 user nova-compute[75438]:   <cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='lm'/>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>kvm64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>core2duo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Penryn</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G1</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Conroe</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:   </cpu>
Nov 09 01:58:21 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:21 user nova-compute[75438]:   <devices>
Nov 09 01:58:21 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </disk>
Nov 09 01:58:21 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </graphics>
Nov 09 01:58:21 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </video>
Nov 09 01:58:21 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:21 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:21 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </rng>
Nov 09 01:58:21 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:21 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </tpm>
Nov 09 01:58:21 user nova-compute[75438]:   </devices>
Nov 09 01:58:21 user nova-compute[75438]:   <features>
Nov 09 01:58:21 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:   </features>
Nov 09 01:58:21 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 09 01:58:21 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 01:58:21 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:21 user nova-compute[75438]:   <machine>pc-i440fx-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:   <arch>i686</arch>
Nov 09 01:58:21 user nova-compute[75438]:   <vcpu max='255'/>
Nov 09 01:58:21 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='firmware'/>
Nov 09 01:58:21 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </loader>
Nov 09 01:58:21 user nova-compute[75438]:   </os>
Nov 09 01:58:21 user nova-compute[75438]:   <cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='lm'/>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>kvm64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>core2duo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Penryn</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G1</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Conroe</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:   </cpu>
Nov 09 01:58:21 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:21 user nova-compute[75438]:   <devices>
Nov 09 01:58:21 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ide</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </disk>
Nov 09 01:58:21 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </graphics>
Nov 09 01:58:21 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </video>
Nov 09 01:58:21 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:21 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:21 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </rng>
Nov 09 01:58:21 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:21 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </tpm>
Nov 09 01:58:21 user nova-compute[75438]:   </devices>
Nov 09 01:58:21 user nova-compute[75438]:   <features>
Nov 09 01:58:21 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:   </features>
Nov 09 01:58:21 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 09 01:58:21 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 01:58:21 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:21 user nova-compute[75438]:   <machine>pc-q35-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:   <arch>i686</arch>
Nov 09 01:58:21 user nova-compute[75438]:   <vcpu max='288'/>
Nov 09 01:58:21 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='firmware'/>
Nov 09 01:58:21 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </loader>
Nov 09 01:58:21 user nova-compute[75438]:   </os>
Nov 09 01:58:21 user nova-compute[75438]:   <cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='lm'/>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>kvm64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>core2duo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Penryn</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G1</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Conroe</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:   </cpu>
Nov 09 01:58:21 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:21 user nova-compute[75438]:   <devices>
Nov 09 01:58:21 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </disk>
Nov 09 01:58:21 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </graphics>
Nov 09 01:58:21 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </video>
Nov 09 01:58:21 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:21 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:21 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </rng>
Nov 09 01:58:21 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:21 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </tpm>
Nov 09 01:58:21 user nova-compute[75438]:   </devices>
Nov 09 01:58:21 user nova-compute[75438]:   <features>
Nov 09 01:58:21 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:   </features>
Nov 09 01:58:21 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 09 01:58:21 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <path>/usr/bin/qemu-system-i386</path>
Nov 09 01:58:21 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:21 user nova-compute[75438]:   <machine>pc-i440fx-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:   <arch>i686</arch>
Nov 09 01:58:21 user nova-compute[75438]:   <vcpu max='255'/>
Nov 09 01:58:21 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='firmware'/>
Nov 09 01:58:21 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </loader>
Nov 09 01:58:21 user nova-compute[75438]:   </os>
Nov 09 01:58:21 user nova-compute[75438]:   <cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='lm'/>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>kvm64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>core2duo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Westmere</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Penryn</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G1</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Nehalem</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Conroe</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:   </cpu>
Nov 09 01:58:21 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:21 user nova-compute[75438]:   <devices>
Nov 09 01:58:21 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ide</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </disk>
Nov 09 01:58:21 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </graphics>
Nov 09 01:58:21 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </video>
Nov 09 01:58:21 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:21 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:21 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </rng>
Nov 09 01:58:21 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:21 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </tpm>
Nov 09 01:58:21 user nova-compute[75438]:   </devices>
Nov 09 01:58:21 user nova-compute[75438]:   <features>
Nov 09 01:58:21 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:   </features>
Nov 09 01:58:21 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 09 01:58:21 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 01:58:21 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:21 user nova-compute[75438]:   <machine>pc-q35-6.2</machine>
Nov 09 01:58:21 user nova-compute[75438]:   <arch>x86_64</arch>
Nov 09 01:58:21 user nova-compute[75438]:   <vcpu max='288'/>
Nov 09 01:58:21 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='firmware'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>efi</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </loader>
Nov 09 01:58:21 user nova-compute[75438]:   </os>
Nov 09 01:58:21 user nova-compute[75438]:   <cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='invtsc'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='rsba'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>core2duo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Westmere</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Penryn</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Opteron_G1</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Nehalem</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Conroe</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:   </cpu>
Nov 09 01:58:21 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:21 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:21 user nova-compute[75438]:   <devices>
Nov 09 01:58:21 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </disk>
Nov 09 01:58:21 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </graphics>
Nov 09 01:58:21 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </video>
Nov 09 01:58:21 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:21 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:21 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </rng>
Nov 09 01:58:21 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:21 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </tpm>
Nov 09 01:58:21 user nova-compute[75438]:   </devices>
Nov 09 01:58:21 user nova-compute[75438]:   <features>
Nov 09 01:58:21 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:21 user nova-compute[75438]:   </features>
Nov 09 01:58:21 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 09 01:58:21 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:21 user nova-compute[75438]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 01:58:21 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:21 user nova-compute[75438]:   <machine>pc-i440fx-jammy</machine>
Nov 09 01:58:21 user nova-compute[75438]:   <arch>x86_64</arch>
Nov 09 01:58:21 user nova-compute[75438]:   <vcpu max='255'/>
Nov 09 01:58:21 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:21 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:     <enum name='firmware'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>efi</value>
Nov 09 01:58:21 user nova-compute[75438]:     </enum>
Nov 09 01:58:21 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </loader>
Nov 09 01:58:21 user nova-compute[75438]:   </os>
Nov 09 01:58:21 user nova-compute[75438]:   <cpu>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:21 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:21 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:21 user nova-compute[75438]:       </enum>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='invtsc'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='rsba'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:21 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:21 user nova-compute[75438]:     </mode>
Nov 09 01:58:21 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm64</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>core2duo</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Westmere</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:21 user nova-compute[75438]:       <model usable='yes'>Penryn</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Opteron_G1</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Nehalem</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Conroe</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:   </cpu>
Nov 09 01:58:22 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:22 user nova-compute[75438]:     </enum>
Nov 09 01:58:22 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:22 user nova-compute[75438]:   <devices>
Nov 09 01:58:22 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>ide</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </disk>
Nov 09 01:58:22 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </graphics>
Nov 09 01:58:22 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </video>
Nov 09 01:58:22 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:22 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:22 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </rng>
Nov 09 01:58:22 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:22 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </tpm>
Nov 09 01:58:22 user nova-compute[75438]:   </devices>
Nov 09 01:58:22 user nova-compute[75438]:   <features>
Nov 09 01:58:22 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:22 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:22 user nova-compute[75438]:   </features>
Nov 09 01:58:22 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:22 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 09 01:58:22 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:22 user nova-compute[75438]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 01:58:22 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:22 user nova-compute[75438]:   <machine>pc-q35-jammy</machine>
Nov 09 01:58:22 user nova-compute[75438]:   <arch>x86_64</arch>
Nov 09 01:58:22 user nova-compute[75438]:   <vcpu max='288'/>
Nov 09 01:58:22 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:     <enum name='firmware'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>efi</value>
Nov 09 01:58:22 user nova-compute[75438]:     </enum>
Nov 09 01:58:22 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </loader>
Nov 09 01:58:22 user nova-compute[75438]:   </os>
Nov 09 01:58:22 user nova-compute[75438]:   <cpu>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='invtsc'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='rsba'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>kvm64</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>core2duo</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Westmere</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Penryn</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Opteron_G1</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Nehalem</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Conroe</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:   </cpu>
Nov 09 01:58:22 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:22 user nova-compute[75438]:     </enum>
Nov 09 01:58:22 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:22 user nova-compute[75438]:   <devices>
Nov 09 01:58:22 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </disk>
Nov 09 01:58:22 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </graphics>
Nov 09 01:58:22 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </video>
Nov 09 01:58:22 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:22 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:22 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </rng>
Nov 09 01:58:22 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:22 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </tpm>
Nov 09 01:58:22 user nova-compute[75438]:   </devices>
Nov 09 01:58:22 user nova-compute[75438]:   <features>
Nov 09 01:58:22 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:22 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:22 user nova-compute[75438]:   </features>
Nov 09 01:58:22 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:22 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 09 01:58:22 user nova-compute[75438]: <domainCapabilities>
Nov 09 01:58:22 user nova-compute[75438]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 09 01:58:22 user nova-compute[75438]:   <domain>kvm</domain>
Nov 09 01:58:22 user nova-compute[75438]:   <machine>pc-i440fx-6.2</machine>
Nov 09 01:58:22 user nova-compute[75438]:   <arch>x86_64</arch>
Nov 09 01:58:22 user nova-compute[75438]:   <vcpu max='255'/>
Nov 09 01:58:22 user nova-compute[75438]:   <iothreads supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:   <os supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:     <enum name='firmware'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>efi</value>
Nov 09 01:58:22 user nova-compute[75438]:     </enum>
Nov 09 01:58:22 user nova-compute[75438]:     <loader supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>rom</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>pflash</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='readonly'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>yes</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='secure'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>no</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </loader>
Nov 09 01:58:22 user nova-compute[75438]:   </os>
Nov 09 01:58:22 user nova-compute[75438]:   <cpu>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='host-passthrough' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='hostPassthroughMigratable'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='maximum' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='maximumMigratable'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>on</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>off</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='host-model' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <vendor>Intel</vendor>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ss'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='vmx'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='pcid'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='hypervisor'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='arat'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='tsc_adjust'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='umip'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='md-clear'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='stibp'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='arch-capabilities'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ssbd'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='invtsc'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ibpb'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='ibrs'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='amd-stibp'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='amd-ssbd'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='rsba'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='require' name='pschange-mc-no'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='disable' name='erms'/>
Nov 09 01:58:22 user nova-compute[75438]:       <feature policy='disable' name='xsaveopt'/>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:     <mode name='custom' supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>qemu64</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>qemu32</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>phenom</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>pentium3</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>pentium2</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>pentium</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>n270</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>kvm64</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>kvm32</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>coreduo</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>core2duo</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>athlon</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Westmere-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Westmere</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Snowridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Skylake-Client</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>SandyBridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Penryn</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G5</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G4</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G3</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Opteron_G2</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Opteron_G1</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Nehalem</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>IvyBridge</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Icelake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Haswell</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-Rome</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-Milan</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC-IBPB</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>EPYC</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Dhyana</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cooperlake</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>Conroe</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Cascadelake-Server</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-noTSX</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell-IBRS</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='no'>Broadwell</model>
Nov 09 01:58:22 user nova-compute[75438]:       <model usable='yes'>486</model>
Nov 09 01:58:22 user nova-compute[75438]:     </mode>
Nov 09 01:58:22 user nova-compute[75438]:   </cpu>
Nov 09 01:58:22 user nova-compute[75438]:   <memoryBacking supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:     <enum name='sourceType'>
Nov 09 01:58:22 user nova-compute[75438]:       <value>file</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>anonymous</value>
Nov 09 01:58:22 user nova-compute[75438]:       <value>memfd</value>
Nov 09 01:58:22 user nova-compute[75438]:     </enum>
Nov 09 01:58:22 user nova-compute[75438]:   </memoryBacking>
Nov 09 01:58:22 user nova-compute[75438]:   <devices>
Nov 09 01:58:22 user nova-compute[75438]:     <disk supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='diskDevice'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>disk</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>cdrom</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>floppy</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>lun</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='bus'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>ide</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>fdc</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>sata</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </disk>
Nov 09 01:58:22 user nova-compute[75438]:     <graphics supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='type'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>sdl</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vnc</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>spice</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>egl-headless</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </graphics>
Nov 09 01:58:22 user nova-compute[75438]:     <video supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='modelType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vga</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>cirrus</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>vmvga</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>qxl</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>none</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>bochs</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>ramfb</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </video>
Nov 09 01:58:22 user nova-compute[75438]:     <hostdev supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='mode'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>subsystem</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='startupPolicy'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>default</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>mandatory</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>requisite</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>optional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='subsysType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>usb</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>pci</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>scsi</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='capsType'/>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='pciBackend'/>
Nov 09 01:58:22 user nova-compute[75438]:     </hostdev>
Nov 09 01:58:22 user nova-compute[75438]:     <rng supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtio-non-transitional</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>random</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>egd</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>builtin</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </rng>
Nov 09 01:58:22 user nova-compute[75438]:     <filesystem supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='driverType'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>path</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>handle</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>virtiofs</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </filesystem>
Nov 09 01:58:22 user nova-compute[75438]:     <tpm supported='yes'>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='model'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>tpm-tis</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>tpm-crb</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:       <enum name='backendModel'>
Nov 09 01:58:22 user nova-compute[75438]:         <value>passthrough</value>
Nov 09 01:58:22 user nova-compute[75438]:         <value>emulator</value>
Nov 09 01:58:22 user nova-compute[75438]:       </enum>
Nov 09 01:58:22 user nova-compute[75438]:     </tpm>
Nov 09 01:58:22 user nova-compute[75438]:   </devices>
Nov 09 01:58:22 user nova-compute[75438]:   <features>
Nov 09 01:58:22 user nova-compute[75438]:     <gic supported='no'/>
Nov 09 01:58:22 user nova-compute[75438]:     <vmcoreinfo supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <genid supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <backingStoreInput supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <backup supported='yes'/>
Nov 09 01:58:22 user nova-compute[75438]:     <sev supported='no'/>
Nov 09 01:58:22 user nova-compute[75438]:   </features>
Nov 09 01:58:22 user nova-compute[75438]: </domainCapabilities>
Nov 09 01:58:22 user nova-compute[75438]:  {{(pid=75438) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75438) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75438) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Checking secure boot support for host arch (x86_64) {{(pid=75438) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Secure Boot support detected
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] cpu compare xml: <cpu match="exact">
Nov 09 01:58:22 user nova-compute[75438]:   <model>Nehalem</model>
Nov 09 01:58:22 user nova-compute[75438]: </cpu>
Nov 09 01:58:22 user nova-compute[75438]:  {{(pid=75438) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.virt.node [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Generated node identity bfe02387-c3a8-4a94-8642-7f0b913b986c
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.virt.node [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Wrote node identity bfe02387-c3a8-4a94-8642-7f0b913b986c to /opt/stack/data/nova/compute_id
Nov 09 01:58:22 user nova-compute[75438]: WARNING nova.compute.manager [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Compute nodes ['bfe02387-c3a8-4a94-8642-7f0b913b986c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.compute.manager [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 09 01:58:22 user nova-compute[75438]: WARNING nova.compute.manager [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 09 01:58:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:58:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:58:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Hypervisor/Node resource view: name=user free_ram=10961MB free_disk=26.107654571533203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:58:22 user nova-compute[75438]: WARNING nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] No compute node record for user:bfe02387-c3a8-4a94-8642-7f0b913b986c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host bfe02387-c3a8-4a94-8642-7f0b913b986c could not be found.
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Compute node record created for user:user with uuid: bfe02387-c3a8-4a94-8642-7f0b913b986c
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] [req-deedd06b-d307-4861-a892-51ccfa48f461] Created resource provider record via placement API for resource provider with UUID bfe02387-c3a8-4a94-8642-7f0b913b986c and name user.
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75438) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 09 01:58:22 user nova-compute[75438]: INFO nova.virt.libvirt.host [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] kernel doesn't support AMD SEV
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Libvirt baseline CPU <cpu>
Nov 09 01:58:22 user nova-compute[75438]:   <arch>x86_64</arch>
Nov 09 01:58:22 user nova-compute[75438]:   <model>Nehalem</model>
Nov 09 01:58:22 user nova-compute[75438]:   <vendor>Intel</vendor>
Nov 09 01:58:22 user nova-compute[75438]:   <topology sockets="6" cores="1" threads="1"/>
Nov 09 01:58:22 user nova-compute[75438]: </cpu>
Nov 09 01:58:22 user nova-compute[75438]:  {{(pid=75438) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Updated inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Updating resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c generation from 0 to 1 during operation: update_inventory {{(pid=75438) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 09 01:58:22 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 01:58:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Updating resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c generation from 1 to 2 during operation: update_traits {{(pid=75438) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 09 01:58:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:58:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:58:23 user nova-compute[75438]: DEBUG nova.service [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Creating RPC server for service compute {{(pid=75438) start /opt/stack/nova/nova/service.py:182}}
Nov 09 01:58:23 user nova-compute[75438]: DEBUG nova.service [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] Join ServiceGroup membership for this service compute {{(pid=75438) start /opt/stack/nova/nova/service.py:199}}
Nov 09 01:58:23 user nova-compute[75438]: DEBUG nova.servicegroup.drivers.db [None req-5fb4ae32-4ae8-4a4e-a368-01f02c5f1d57 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75438) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 09 01:59:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 01:59:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 01:59:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:59:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 01:59:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=10436MB free_disk=25.880691528320312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 01:59:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:00:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:00:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=10402MB free_disk=25.94552993774414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:00:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:01:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:01:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:01:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:01:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=10435MB free_disk=25.699878692626953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:01:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:01:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:01:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:14 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:02:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9690MB free_disk=25.726150512695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:02:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:02:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:24 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:02:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:02:25 user nova-compute[75438]: INFO nova.compute.claims [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Claim successful on node user
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:02:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:02:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Creating image(s)
Nov 09 02:02:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "/opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "/opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:26 user nova-compute[75438]: DEBUG nova.policy [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aabdffb27b96446997cf07a179f19636', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f222b77aad794a479937ad3ce632421a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:02:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG nova.virt.images [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] f16943d9-f085-4472-9bf0-c9432a882a19 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.part /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.part /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.converted" returned: 0 in 0.227s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.590s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:27 user nova-compute[75438]: INFO oslo.privsep.daemon [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpbb3w5a9a/privsep.sock']
Nov 09 02:02:27 user sudo[84899]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpbb3w5a9a/privsep.sock
Nov 09 02:02:27 user sudo[84899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:02:28 user nova-compute[75438]: INFO nova.compute.claims [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Claim successful on node user
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Successfully created port: e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:02:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.policy [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab1818da0f7a44fe8ae3f9ffce360386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bdfa4af42b4c9796dd143f0c4c3da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:02:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Creating image(s)
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:29 user sudo[84899]: pam_unix(sudo:session): session closed for user root
Nov 09 02:02:29 user nova-compute[75438]: INFO oslo.privsep.daemon [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Spawned new privsep daemon via rootwrap
Nov 09 02:02:29 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 02:02:29 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 02:02:29 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 09 02:02:29 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84908
Nov 09 02:02:29 user nova-compute[75438]: WARNING oslo_privsep.priv_context [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] privsep daemon already running
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.255s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:02:29 user nova-compute[75438]: INFO nova.compute.claims [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Claim successful on node user
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk 1073741824" returned: 0 in 0.043s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.254s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:29 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk 1073741824" returned: 0 in 0.047s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:02:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Cannot resize image /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Ensure instance console log exists: /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.212s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:02:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Creating image(s)
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.policy [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be52867f38a447129d9960106a2525f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a20628afe4aa4c0aae9c883d4531cc74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Cannot resize image /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Ensure instance console log exists: /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Successfully created port: 451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk 1073741824" returned: 0 in 0.060s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:02:30 user nova-compute[75438]: INFO nova.compute.claims [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Claim successful on node user
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Successfully updated port: e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquired lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Cannot resize image /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Ensure instance console log exists: /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:02:31 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-changed-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Refreshing instance network info cache due to event network-changed-e451a393-86bc-428f-9f3b-cb5d9541507e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] Acquiring lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:02:31 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Creating image(s)
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG nova.policy [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab1818da0f7a44fe8ae3f9ffce360386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bdfa4af42b4c9796dd143f0c4c3da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk 1073741824" returned: 0 in 0.050s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updating instance_info_cache with network_info: [{"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Releasing lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Instance network_info: |[{"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] Acquired lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Refreshing network info cache for port e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Start _get_guest_xml network_info=[{"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1032747937',display_name='tempest-DeleteServersTestJSON-server-1032747937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1032747937',id=1,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f222b77aad794a479937ad3ce632421a',ramdisk_id='',reservation_id='r-yckul1ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-653233604',owner_user_name='tempest-DeleteServersTestJSON-653233604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:26Z,user_data=None,user_id='aabdffb27b96446997cf07a179f19636',uuid=1ba28925-aff6-48f5-a4c9-8498efc7c809,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Converting VIF {"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ba28925-aff6-48f5-a4c9-8498efc7c809 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:02:32 user nova-compute[75438]:   <uuid>1ba28925-aff6-48f5-a4c9-8498efc7c809</uuid>
Nov 09 02:02:32 user nova-compute[75438]:   <name>instance-00000001</name>
Nov 09 02:02:32 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:02:32 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:02:32 user nova-compute[75438]:   <metadata>
Nov 09 02:02:32 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:02:32 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:02:32 user nova-compute[75438]:       <nova:name>tempest-DeleteServersTestJSON-server-1032747937</nova:name>
Nov 09 02:02:32 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:02:32</nova:creationTime>
Nov 09 02:02:32 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:02:32 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:02:32 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:02:32 user nova-compute[75438]:       <nova:owner>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:user uuid="aabdffb27b96446997cf07a179f19636">tempest-DeleteServersTestJSON-653233604-project-member</nova:user>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:project uuid="f222b77aad794a479937ad3ce632421a">tempest-DeleteServersTestJSON-653233604</nova:project>
Nov 09 02:02:32 user nova-compute[75438]:       </nova:owner>
Nov 09 02:02:32 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:02:32 user nova-compute[75438]:       <nova:ports>
Nov 09 02:02:32 user nova-compute[75438]:         <nova:port uuid="e451a393-86bc-428f-9f3b-cb5d9541507e">
Nov 09 02:02:32 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:02:32 user nova-compute[75438]:         </nova:port>
Nov 09 02:02:32 user nova-compute[75438]:       </nova:ports>
Nov 09 02:02:32 user nova-compute[75438]:     </nova:instance>
Nov 09 02:02:32 user nova-compute[75438]:   </metadata>
Nov 09 02:02:32 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:02:32 user nova-compute[75438]:     <system>
Nov 09 02:02:32 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:02:32 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:02:32 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:02:32 user nova-compute[75438]:       <entry name="serial">1ba28925-aff6-48f5-a4c9-8498efc7c809</entry>
Nov 09 02:02:32 user nova-compute[75438]:       <entry name="uuid">1ba28925-aff6-48f5-a4c9-8498efc7c809</entry>
Nov 09 02:02:32 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:02:32 user nova-compute[75438]:     </system>
Nov 09 02:02:32 user nova-compute[75438]:   </sysinfo>
Nov 09 02:02:32 user nova-compute[75438]:   <os>
Nov 09 02:02:32 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:02:32 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:02:32 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:02:32 user nova-compute[75438]:   </os>
Nov 09 02:02:32 user nova-compute[75438]:   <features>
Nov 09 02:02:32 user nova-compute[75438]:     <acpi/>
Nov 09 02:02:32 user nova-compute[75438]:     <apic/>
Nov 09 02:02:32 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:02:32 user nova-compute[75438]:   </features>
Nov 09 02:02:32 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:02:32 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:02:32 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:02:32 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:02:32 user nova-compute[75438]:   </clock>
Nov 09 02:02:32 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:02:32 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:02:32 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:02:32 user nova-compute[75438]:   </cpu>
Nov 09 02:02:32 user nova-compute[75438]:   <devices>
Nov 09 02:02:32 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:02:32 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:02:32 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk"/>
Nov 09 02:02:32 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:02:32 user nova-compute[75438]:     </disk>
Nov 09 02:02:32 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:02:32 user nova-compute[75438]:       <mac address="fa:16:3e:6a:85:0b"/>
Nov 09 02:02:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:32 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:02:32 user nova-compute[75438]:       <target dev="tape451a393-86"/>
Nov 09 02:02:32 user nova-compute[75438]:     </interface>
Nov 09 02:02:32 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:02:32 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/console.log" append="off"/>
Nov 09 02:02:32 user nova-compute[75438]:     </serial>
Nov 09 02:02:32 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:02:32 user nova-compute[75438]:     <video>
Nov 09 02:02:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:32 user nova-compute[75438]:     </video>
Nov 09 02:02:32 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:02:32 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:02:32 user nova-compute[75438]:     </rng>
Nov 09 02:02:32 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:02:32 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:02:32 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:02:32 user nova-compute[75438]:     </memballoon>
Nov 09 02:02:32 user nova-compute[75438]:   </devices>
Nov 09 02:02:32 user nova-compute[75438]: </domain>
Nov 09 02:02:32 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1032747937',display_name='tempest-DeleteServersTestJSON-server-1032747937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1032747937',id=1,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f222b77aad794a479937ad3ce632421a',ramdisk_id='',reservation_id='r-yckul1ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-653233604',owner_user_name='tempest-DeleteServersTestJSON-653233604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:26Z,user_data=None,user_id='aabdffb27b96446997cf07a179f19636',uuid=1ba28925-aff6-48f5-a4c9-8498efc7c809,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Converting VIF {"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG os_vif [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Created schema index Interface.name {{(pid=75438) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Created schema index Port.name {{(pid=75438) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Created schema index Bridge.name {{(pid=75438) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [POLLOUT] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Cannot resize image /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Ensure instance console log exists: /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0de92831-3c53-5fc1-a3ec-c55252d76a71', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:32 user nova-compute[75438]: INFO oslo.privsep.daemon [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpeqcb5px_/privsep.sock']
Nov 09 02:02:32 user sudo[84977]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpeqcb5px_/privsep.sock
Nov 09 02:02:32 user sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Successfully created port: 9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Successfully updated port: 451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-changed-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Refreshing instance network info cache due to event network-changed-451325f5-662e-4cc1-893f-f44ae03ac241. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updated VIF entry in instance network info cache for port e451a393-86bc-428f-9f3b-cb5d9541507e. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updating instance_info_cache with network_info: [{"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b8d1ab0-bdea-4fba-80fe-8ee0a1c9e141 req-9cd52325-cf30-4446-b5b7-bdd84e672544 service nova] Releasing lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:34 user sudo[84977]: pam_unix(sudo:session): session closed for user root
Nov 09 02:02:34 user nova-compute[75438]: INFO oslo.privsep.daemon [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Spawned new privsep daemon via rootwrap
Nov 09 02:02:34 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 02:02:34 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 02:02:34 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 09 02:02:34 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84980
Nov 09 02:02:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Successfully created port: d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape451a393-86, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape451a393-86, col_values=(('qos', UUID('ba2a114f-3785-4940-b5f8-7eb120e956f3')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape451a393-86, col_values=(('external_ids', {'iface-id': 'e451a393-86bc-428f-9f3b-cb5d9541507e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:85:0b', 'vm-uuid': '1ba28925-aff6-48f5-a4c9-8498efc7c809'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:34 user nova-compute[75438]: INFO os_vif [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86')
Nov 09 02:02:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:02:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] No VIF found with MAC fa:16:3e:6a:85:0b, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance network_info: |[{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.network.neutron [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Refreshing network info cache for port 451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Start _get_guest_xml network_info=[{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:02:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1073959700',display_name='tempest-ServerRescueNegativeTestJSON-server-1073959700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1073959700',id=2,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-7fepwe91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:29Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=3be630c7-6913-421f-aa2e-19f3208b12e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'pci_devices' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:02:35 user nova-compute[75438]:   <uuid>3be630c7-6913-421f-aa2e-19f3208b12e7</uuid>
Nov 09 02:02:35 user nova-compute[75438]:   <name>instance-00000002</name>
Nov 09 02:02:35 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:02:35 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:02:35 user nova-compute[75438]:   <metadata>
Nov 09 02:02:35 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:02:35 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:02:35 user nova-compute[75438]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1073959700</nova:name>
Nov 09 02:02:35 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:02:35</nova:creationTime>
Nov 09 02:02:35 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:02:35 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:02:35 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:02:35 user nova-compute[75438]:       <nova:owner>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:user uuid="ab1818da0f7a44fe8ae3f9ffce360386">tempest-ServerRescueNegativeTestJSON-655487496-project-member</nova:user>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:project uuid="92bdfa4af42b4c9796dd143f0c4c3da1">tempest-ServerRescueNegativeTestJSON-655487496</nova:project>
Nov 09 02:02:35 user nova-compute[75438]:       </nova:owner>
Nov 09 02:02:35 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:02:35 user nova-compute[75438]:       <nova:ports>
Nov 09 02:02:35 user nova-compute[75438]:         <nova:port uuid="451325f5-662e-4cc1-893f-f44ae03ac241">
Nov 09 02:02:35 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 02:02:35 user nova-compute[75438]:         </nova:port>
Nov 09 02:02:35 user nova-compute[75438]:       </nova:ports>
Nov 09 02:02:35 user nova-compute[75438]:     </nova:instance>
Nov 09 02:02:35 user nova-compute[75438]:   </metadata>
Nov 09 02:02:35 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:02:35 user nova-compute[75438]:     <system>
Nov 09 02:02:35 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:02:35 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:02:35 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:02:35 user nova-compute[75438]:       <entry name="serial">3be630c7-6913-421f-aa2e-19f3208b12e7</entry>
Nov 09 02:02:35 user nova-compute[75438]:       <entry name="uuid">3be630c7-6913-421f-aa2e-19f3208b12e7</entry>
Nov 09 02:02:35 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:02:35 user nova-compute[75438]:     </system>
Nov 09 02:02:35 user nova-compute[75438]:   </sysinfo>
Nov 09 02:02:35 user nova-compute[75438]:   <os>
Nov 09 02:02:35 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:02:35 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:02:35 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:02:35 user nova-compute[75438]:   </os>
Nov 09 02:02:35 user nova-compute[75438]:   <features>
Nov 09 02:02:35 user nova-compute[75438]:     <acpi/>
Nov 09 02:02:35 user nova-compute[75438]:     <apic/>
Nov 09 02:02:35 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:02:35 user nova-compute[75438]:   </features>
Nov 09 02:02:35 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:02:35 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:02:35 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:02:35 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:02:35 user nova-compute[75438]:   </clock>
Nov 09 02:02:35 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:02:35 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:02:35 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:02:35 user nova-compute[75438]:   </cpu>
Nov 09 02:02:35 user nova-compute[75438]:   <devices>
Nov 09 02:02:35 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:02:35 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:02:35 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk"/>
Nov 09 02:02:35 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:02:35 user nova-compute[75438]:     </disk>
Nov 09 02:02:35 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:02:35 user nova-compute[75438]:       <mac address="fa:16:3e:f5:b2:ec"/>
Nov 09 02:02:35 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:35 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:02:35 user nova-compute[75438]:       <target dev="tap451325f5-66"/>
Nov 09 02:02:35 user nova-compute[75438]:     </interface>
Nov 09 02:02:35 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:02:35 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/console.log" append="off"/>
Nov 09 02:02:35 user nova-compute[75438]:     </serial>
Nov 09 02:02:35 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:02:35 user nova-compute[75438]:     <video>
Nov 09 02:02:35 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:35 user nova-compute[75438]:     </video>
Nov 09 02:02:35 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:02:35 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:02:35 user nova-compute[75438]:     </rng>
Nov 09 02:02:35 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:02:35 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:02:35 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:02:35 user nova-compute[75438]:     </memballoon>
Nov 09 02:02:35 user nova-compute[75438]:   </devices>
Nov 09 02:02:35 user nova-compute[75438]: </domain>
Nov 09 02:02:35 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1073959700',display_name='tempest-ServerRescueNegativeTestJSON-server-1073959700',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1073959700',id=2,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-7fepwe91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:29Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=3be630c7-6913-421f-aa2e-19f3208b12e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG os_vif [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5d25795-ce39-56c3-a83b-d202f11a490d', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap451325f5-66, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap451325f5-66, col_values=(('qos', UUID('8ae8d92b-f0dd-44fd-89ac-21e235ce8a86')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap451325f5-66, col_values=(('external_ids', {'iface-id': '451325f5-662e-4cc1-893f-f44ae03ac241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b2:ec', 'vm-uuid': '3be630c7-6913-421f-aa2e-19f3208b12e7'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:35 user nova-compute[75438]: INFO os_vif [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66')
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:02:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:f5:b2:ec, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Successfully updated port: 9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-changed-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Refreshing instance network info cache due to event network-changed-9c8b67f2-a61a-4580-85c9-ee3583275dc7. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updated VIF entry in instance network info cache for port 451325f5-662e-4cc1-893f-f44ae03ac241. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-224cb3b3-7364-439f-9e07-2bcbf42a2eea req-f6c247d3-bdda-4fa2-af4a-4b3ea13b33d3 service nova] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Successfully updated port: d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-changed-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Refreshing instance network info cache due to event network-changed-d1d3d251-36fe-4955-8d02-26d0d818069f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:02:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] Acquiring lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:02:37 user nova-compute[75438]: INFO nova.compute.claims [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Claim successful on node user
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance network_info: |[{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] Acquired lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.neutron [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Refreshing network info cache for port d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Start _get_guest_xml network_info=[{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:02:37 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:37 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296716460',display_name='tempest-ServerRescueNegativeTestJSON-server-296716460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296716460',id=4,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-i6k9lj2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:31Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:02:37 user nova-compute[75438]:   <uuid>6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88</uuid>
Nov 09 02:02:37 user nova-compute[75438]:   <name>instance-00000004</name>
Nov 09 02:02:37 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:02:37 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:02:37 user nova-compute[75438]:   <metadata>
Nov 09 02:02:37 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:02:37 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-296716460</nova:name>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:02:37</nova:creationTime>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:02:37 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:02:37 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:owner>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:user uuid="ab1818da0f7a44fe8ae3f9ffce360386">tempest-ServerRescueNegativeTestJSON-655487496-project-member</nova:user>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:project uuid="92bdfa4af42b4c9796dd143f0c4c3da1">tempest-ServerRescueNegativeTestJSON-655487496</nova:project>
Nov 09 02:02:37 user nova-compute[75438]:       </nova:owner>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:ports>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:port uuid="d1d3d251-36fe-4955-8d02-26d0d818069f">
Nov 09 02:02:37 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:02:37 user nova-compute[75438]:         </nova:port>
Nov 09 02:02:37 user nova-compute[75438]:       </nova:ports>
Nov 09 02:02:37 user nova-compute[75438]:     </nova:instance>
Nov 09 02:02:37 user nova-compute[75438]:   </metadata>
Nov 09 02:02:37 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:02:37 user nova-compute[75438]:     <system>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="serial">6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="uuid">6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:02:37 user nova-compute[75438]:     </system>
Nov 09 02:02:37 user nova-compute[75438]:   </sysinfo>
Nov 09 02:02:37 user nova-compute[75438]:   <os>
Nov 09 02:02:37 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:02:37 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:02:37 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:02:37 user nova-compute[75438]:   </os>
Nov 09 02:02:37 user nova-compute[75438]:   <features>
Nov 09 02:02:37 user nova-compute[75438]:     <acpi/>
Nov 09 02:02:37 user nova-compute[75438]:     <apic/>
Nov 09 02:02:37 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:02:37 user nova-compute[75438]:   </features>
Nov 09 02:02:37 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:02:37 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:02:37 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:02:37 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:02:37 user nova-compute[75438]:   </clock>
Nov 09 02:02:37 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:02:37 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:02:37 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:02:37 user nova-compute[75438]:   </cpu>
Nov 09 02:02:37 user nova-compute[75438]:   <devices>
Nov 09 02:02:37 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:02:37 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:02:37 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk"/>
Nov 09 02:02:37 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:02:37 user nova-compute[75438]:     </disk>
Nov 09 02:02:37 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:02:37 user nova-compute[75438]:       <mac address="fa:16:3e:53:cf:94"/>
Nov 09 02:02:37 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:37 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:02:37 user nova-compute[75438]:       <target dev="tapd1d3d251-36"/>
Nov 09 02:02:37 user nova-compute[75438]:     </interface>
Nov 09 02:02:37 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:02:37 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/console.log" append="off"/>
Nov 09 02:02:37 user nova-compute[75438]:     </serial>
Nov 09 02:02:37 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:02:37 user nova-compute[75438]:     <video>
Nov 09 02:02:37 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:37 user nova-compute[75438]:     </video>
Nov 09 02:02:37 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:02:37 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:02:37 user nova-compute[75438]:     </rng>
Nov 09 02:02:37 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:02:37 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:02:37 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:02:37 user nova-compute[75438]:     </memballoon>
Nov 09 02:02:37 user nova-compute[75438]:   </devices>
Nov 09 02:02:37 user nova-compute[75438]: </domain>
Nov 09 02:02:37 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296716460',display_name='tempest-ServerRescueNegativeTestJSON-server-296716460',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296716460',id=4,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-i6k9lj2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:31Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG os_vif [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a70e8aa7-fa3d-5d95-8a6f-e54684ca8cc9', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance network_info: |[{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.neutron [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Refreshing network info cache for port 9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start _get_guest_xml network_info=[{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:02:37 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:37 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1d3d251-36, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1d3d251-36, col_values=(('qos', UUID('8474c493-afaf-40ea-84dd-284bc4608ee1')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1d3d251-36, col_values=(('external_ids', {'iface-id': 'd1d3d251-36fe-4955-8d02-26d0d818069f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:cf:94', 'vm-uuid': '6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'pci_devices' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: INFO os_vif [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36')
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:02:37 user nova-compute[75438]:   <uuid>05bf2ae1-5578-4573-b0c7-9ce14999da93</uuid>
Nov 09 02:02:37 user nova-compute[75438]:   <name>instance-00000003</name>
Nov 09 02:02:37 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:02:37 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:02:37 user nova-compute[75438]:   <metadata>
Nov 09 02:02:37 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:02:37 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherB-server-900109230</nova:name>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:02:37</nova:creationTime>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:02:37 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:02:37 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:owner>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:user uuid="be52867f38a447129d9960106a2525f7">tempest-ServerActionsTestOtherB-1383355237-project-member</nova:user>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:project uuid="a20628afe4aa4c0aae9c883d4531cc74">tempest-ServerActionsTestOtherB-1383355237</nova:project>
Nov 09 02:02:37 user nova-compute[75438]:       </nova:owner>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:02:37 user nova-compute[75438]:       <nova:ports>
Nov 09 02:02:37 user nova-compute[75438]:         <nova:port uuid="9c8b67f2-a61a-4580-85c9-ee3583275dc7">
Nov 09 02:02:37 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:02:37 user nova-compute[75438]:         </nova:port>
Nov 09 02:02:37 user nova-compute[75438]:       </nova:ports>
Nov 09 02:02:37 user nova-compute[75438]:     </nova:instance>
Nov 09 02:02:37 user nova-compute[75438]:   </metadata>
Nov 09 02:02:37 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:02:37 user nova-compute[75438]:     <system>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="serial">05bf2ae1-5578-4573-b0c7-9ce14999da93</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="uuid">05bf2ae1-5578-4573-b0c7-9ce14999da93</entry>
Nov 09 02:02:37 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:02:37 user nova-compute[75438]:     </system>
Nov 09 02:02:37 user nova-compute[75438]:   </sysinfo>
Nov 09 02:02:37 user nova-compute[75438]:   <os>
Nov 09 02:02:37 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:02:37 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:02:37 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:02:37 user nova-compute[75438]:   </os>
Nov 09 02:02:37 user nova-compute[75438]:   <features>
Nov 09 02:02:37 user nova-compute[75438]:     <acpi/>
Nov 09 02:02:37 user nova-compute[75438]:     <apic/>
Nov 09 02:02:37 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:02:37 user nova-compute[75438]:   </features>
Nov 09 02:02:37 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:02:37 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:02:37 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:02:37 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:02:37 user nova-compute[75438]:   </clock>
Nov 09 02:02:37 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:02:37 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:02:37 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:02:37 user nova-compute[75438]:   </cpu>
Nov 09 02:02:37 user nova-compute[75438]:   <devices>
Nov 09 02:02:37 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:02:37 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:02:37 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk"/>
Nov 09 02:02:37 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:02:37 user nova-compute[75438]:     </disk>
Nov 09 02:02:37 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:02:37 user nova-compute[75438]:       <mac address="fa:16:3e:87:5b:eb"/>
Nov 09 02:02:37 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:37 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:02:37 user nova-compute[75438]:       <target dev="tap9c8b67f2-a6"/>
Nov 09 02:02:37 user nova-compute[75438]:     </interface>
Nov 09 02:02:37 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:02:37 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/console.log" append="off"/>
Nov 09 02:02:37 user nova-compute[75438]:     </serial>
Nov 09 02:02:37 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:02:37 user nova-compute[75438]:     <video>
Nov 09 02:02:37 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:37 user nova-compute[75438]:     </video>
Nov 09 02:02:37 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:02:37 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:02:37 user nova-compute[75438]:     </rng>
Nov 09 02:02:37 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:02:37 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:02:37 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:02:37 user nova-compute[75438]:     </memballoon>
Nov 09 02:02:37 user nova-compute[75438]:   </devices>
Nov 09 02:02:37 user nova-compute[75438]: </domain>
Nov 09 02:02:37 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG os_vif [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb851f68-c451-5f30-a0fd-4dee31133f26', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8b67f2-a6, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c8b67f2-a6, col_values=(('qos', UUID('7de4603f-4cb7-46e9-810a-5715be77d620')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c8b67f2-a6, col_values=(('external_ids', {'iface-id': '9c8b67f2-a61a-4580-85c9-ee3583275dc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5b:eb', 'vm-uuid': '05bf2ae1-5578-4573-b0c7-9ce14999da93'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:53:cf:94, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: INFO os_vif [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6')
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No VIF found with MAC fa:16:3e:87:5b:eb, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:02:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:02:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Creating image(s)
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG nova.policy [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a26a0160e8042e3a6a83bdb28a41ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be67d22752084a76b41a4e1cff3747cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk 1073741824" returned: 0 in 0.056s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updated VIF entry in instance network info cache for port d1d3d251-36fe-4955-8d02-26d0d818069f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updated VIF entry in instance network info cache for port 9c8b67f2-a61a-4580-85c9-ee3583275dc7. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-96beeb1e-d98c-4918-aa48-313f6a17e543 req-9789bed9-a32d-43b1-a438-fcac3e0440ce service nova] Releasing lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3e171bdd-c907-417b-ac2b-d62e7881e659 req-8a8888d8-d9d6-4458-a4b5-7ff5826008b6 service nova] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.263s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Cannot resize image /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Ensure instance console log exists: /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:40 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Successfully created port: 71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:02:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Instance spawned successfully.
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:41 user nova-compute[75438]: INFO nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Took 15.48 seconds to spawn the instance on the hypervisor.
Nov 09 02:02:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:02:41 user nova-compute[75438]: INFO nova.compute.manager [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Took 16.70 seconds to build instance.
Nov 09 02:02:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49591f4d-7d60-48f2-8f91-31edf09ffbb3 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.026s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance spawned successfully.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance spawned successfully.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance spawned successfully.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Successfully updated port: 71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Took 15.72 seconds to spawn the instance on the hypervisor.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Took 14.29 seconds to spawn the instance on the hypervisor.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-changed-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Refreshing instance network info cache due to event network-changed-71877205-b0ab-456f-a4e1-9e5f638fb7fc. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Took 13.25 seconds to spawn the instance on the hypervisor.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:02:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.compute.manager [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Took 15.42 seconds to build instance.
Nov 09 02:02:44 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:02:44 user nova-compute[75438]: INFO nova.compute.manager [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Took 16.78 seconds to build instance.
Nov 09 02:02:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbb5de99-cd51-447c-aca9-e940e50106d5 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.596s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:45 user nova-compute[75438]: INFO nova.compute.manager [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Took 14.26 seconds to build instance.
Nov 09 02:02:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61be342d-8042-4789-a5d5-8cf762611a9f tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.954s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-00b301a2-0055-4873-bd6e-8b16de17c929 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.480s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance network_info: |[{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Refreshing network info cache for port 71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start _get_guest_xml network_info=[{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:02:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.objects.instance [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'pci_devices' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:02:46 user nova-compute[75438]:   <uuid>a300e943-2854-4f88-97b1-8d2e2b754f12</uuid>
Nov 09 02:02:46 user nova-compute[75438]:   <name>instance-00000005</name>
Nov 09 02:02:46 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:02:46 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:02:46 user nova-compute[75438]:   <metadata>
Nov 09 02:02:46 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:02:46 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:02:46 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeTestJSON-server-455427829</nova:name>
Nov 09 02:02:46 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:02:46</nova:creationTime>
Nov 09 02:02:46 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:02:46 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:02:46 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:02:46 user nova-compute[75438]:       <nova:owner>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:user uuid="6a26a0160e8042e3a6a83bdb28a41ad0">tempest-AttachVolumeTestJSON-74588244-project-member</nova:user>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:project uuid="be67d22752084a76b41a4e1cff3747cf">tempest-AttachVolumeTestJSON-74588244</nova:project>
Nov 09 02:02:46 user nova-compute[75438]:       </nova:owner>
Nov 09 02:02:46 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:02:46 user nova-compute[75438]:       <nova:ports>
Nov 09 02:02:46 user nova-compute[75438]:         <nova:port uuid="71877205-b0ab-456f-a4e1-9e5f638fb7fc">
Nov 09 02:02:46 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:02:46 user nova-compute[75438]:         </nova:port>
Nov 09 02:02:46 user nova-compute[75438]:       </nova:ports>
Nov 09 02:02:46 user nova-compute[75438]:     </nova:instance>
Nov 09 02:02:46 user nova-compute[75438]:   </metadata>
Nov 09 02:02:46 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:02:46 user nova-compute[75438]:     <system>
Nov 09 02:02:46 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:02:46 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:02:46 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:02:46 user nova-compute[75438]:       <entry name="serial">a300e943-2854-4f88-97b1-8d2e2b754f12</entry>
Nov 09 02:02:46 user nova-compute[75438]:       <entry name="uuid">a300e943-2854-4f88-97b1-8d2e2b754f12</entry>
Nov 09 02:02:46 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:02:46 user nova-compute[75438]:     </system>
Nov 09 02:02:46 user nova-compute[75438]:   </sysinfo>
Nov 09 02:02:46 user nova-compute[75438]:   <os>
Nov 09 02:02:46 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:02:46 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:02:46 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:02:46 user nova-compute[75438]:   </os>
Nov 09 02:02:46 user nova-compute[75438]:   <features>
Nov 09 02:02:46 user nova-compute[75438]:     <acpi/>
Nov 09 02:02:46 user nova-compute[75438]:     <apic/>
Nov 09 02:02:46 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:02:46 user nova-compute[75438]:   </features>
Nov 09 02:02:46 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:02:46 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:02:46 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:02:46 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:02:46 user nova-compute[75438]:   </clock>
Nov 09 02:02:46 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:02:46 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:02:46 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:02:46 user nova-compute[75438]:   </cpu>
Nov 09 02:02:46 user nova-compute[75438]:   <devices>
Nov 09 02:02:46 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:02:46 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:02:46 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk"/>
Nov 09 02:02:46 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:02:46 user nova-compute[75438]:     </disk>
Nov 09 02:02:46 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:02:46 user nova-compute[75438]:       <mac address="fa:16:3e:81:73:9c"/>
Nov 09 02:02:46 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:46 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:02:46 user nova-compute[75438]:       <target dev="tap71877205-b0"/>
Nov 09 02:02:46 user nova-compute[75438]:     </interface>
Nov 09 02:02:46 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:02:46 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/console.log" append="off"/>
Nov 09 02:02:46 user nova-compute[75438]:     </serial>
Nov 09 02:02:46 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:02:46 user nova-compute[75438]:     <video>
Nov 09 02:02:46 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:02:46 user nova-compute[75438]:     </video>
Nov 09 02:02:46 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:02:46 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:02:46 user nova-compute[75438]:     </rng>
Nov 09 02:02:46 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:02:46 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:02:46 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:02:46 user nova-compute[75438]:     </memballoon>
Nov 09 02:02:46 user nova-compute[75438]:   </devices>
Nov 09 02:02:46 user nova-compute[75438]: </domain>
Nov 09 02:02:46 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG os_vif [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92bb3039-d6c5-56dc-b4a9-e30ab4f6317c', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71877205-b0, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71877205-b0, col_values=(('qos', UUID('aca0719f-94ad-43b8-9c6d-410644d54700')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71877205-b0, col_values=(('external_ids', {'iface-id': '71877205-b0ab-456f-a4e1-9e5f638fb7fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:73:9c', 'vm-uuid': 'a300e943-2854-4f88-97b1-8d2e2b754f12'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:46 user nova-compute[75438]: INFO os_vif [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0')
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:02:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No VIF found with MAC fa:16:3e:81:73:9c, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:02:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updated VIF entry in instance network info cache for port 71877205-b0ab-456f-a4e1-9e5f638fb7fc. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:02:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:02:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cfe1aec5-f754-4e10-9f57-c947fece0dbb req-b87ddd69-baa2-4c49-8295-010ff8bccbd0 service nova] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:02:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-91499ab5-2fe2-485a-b140-2e41c1cfa3c8 req-e220bd5c-e054-4d02-b5e8-336971ab6b66 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-91499ab5-2fe2-485a-b140-2e41c1cfa3c8 req-e220bd5c-e054-4d02-b5e8-336971ab6b66 service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-91499ab5-2fe2-485a-b140-2e41c1cfa3c8 req-e220bd5c-e054-4d02-b5e8-336971ab6b66 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-91499ab5-2fe2-485a-b140-2e41c1cfa3c8 req-e220bd5c-e054-4d02-b5e8-336971ab6b66 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-91499ab5-2fe2-485a-b140-2e41c1cfa3c8 req-e220bd5c-e054-4d02-b5e8-336971ab6b66 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:02:50 user nova-compute[75438]: WARNING nova.compute.manager [req-91499ab5-2fe2-485a-b140-2e41c1cfa3c8 req-e220bd5c-e054-4d02-b5e8-336971ab6b66 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state active and task_state None.
Nov 09 02:02:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-729493fe-5c66-4aac-94dd-ddcb156f7392 req-b2a77c21-0155-4244-9d07-c95c76bb1c8a service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-729493fe-5c66-4aac-94dd-ddcb156f7392 req-b2a77c21-0155-4244-9d07-c95c76bb1c8a service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-729493fe-5c66-4aac-94dd-ddcb156f7392 req-b2a77c21-0155-4244-9d07-c95c76bb1c8a service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-729493fe-5c66-4aac-94dd-ddcb156f7392 req-b2a77c21-0155-4244-9d07-c95c76bb1c8a service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-729493fe-5c66-4aac-94dd-ddcb156f7392 req-b2a77c21-0155-4244-9d07-c95c76bb1c8a service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:02:50 user nova-compute[75438]: WARNING nova.compute.manager [req-729493fe-5c66-4aac-94dd-ddcb156f7392 req-b2a77c21-0155-4244-9d07-c95c76bb1c8a service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state active and task_state None.
Nov 09 02:02:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:02:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance spawned successfully.
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-94ccace4-2ca2-4982-ba9c-c5d20431bf6c req-3f12f42f-629c-4983-ab52-1a9a57f7f02e service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-94ccace4-2ca2-4982-ba9c-c5d20431bf6c req-3f12f42f-629c-4983-ab52-1a9a57f7f02e service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-94ccace4-2ca2-4982-ba9c-c5d20431bf6c req-3f12f42f-629c-4983-ab52-1a9a57f7f02e service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-94ccace4-2ca2-4982-ba9c-c5d20431bf6c req-3f12f42f-629c-4983-ab52-1a9a57f7f02e service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-94ccace4-2ca2-4982-ba9c-c5d20431bf6c req-3f12f42f-629c-4983-ab52-1a9a57f7f02e service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:02:52 user nova-compute[75438]: WARNING nova.compute.manager [req-94ccace4-2ca2-4982-ba9c-c5d20431bf6c req-3f12f42f-629c-4983-ab52-1a9a57f7f02e service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state active and task_state None.
Nov 09 02:02:52 user nova-compute[75438]: INFO nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Took 13.76 seconds to spawn the instance on the hypervisor.
Nov 09 02:02:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:02:52 user nova-compute[75438]: INFO nova.compute.manager [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Took 14.99 seconds to build instance.
Nov 09 02:02:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0d0874d5-eaaa-4c1d-b593-1f7633876e6c tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.141s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-d2dfd4c4-5569-47b9-a8c3-8b0c4cb8bc17 req-ead3893f-51bf-45f8-8a7e-f2b54a7fd068 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:02:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d2dfd4c4-5569-47b9-a8c3-8b0c4cb8bc17 req-ead3893f-51bf-45f8-8a7e-f2b54a7fd068 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d2dfd4c4-5569-47b9-a8c3-8b0c4cb8bc17 req-ead3893f-51bf-45f8-8a7e-f2b54a7fd068 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d2dfd4c4-5569-47b9-a8c3-8b0c4cb8bc17 req-ead3893f-51bf-45f8-8a7e-f2b54a7fd068 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-d2dfd4c4-5569-47b9-a8c3-8b0c4cb8bc17 req-ead3893f-51bf-45f8-8a7e-f2b54a7fd068 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:02:53 user nova-compute[75438]: WARNING nova.compute.manager [req-d2dfd4c4-5569-47b9-a8c3-8b0c4cb8bc17 req-ead3893f-51bf-45f8-8a7e-f2b54a7fd068 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state active and task_state None.
Nov 09 02:02:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:02:58 user nova-compute[75438]: INFO nova.compute.claims [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Claim successful on node user
Nov 09 02:02:58 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:02:58 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.888s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:02:59 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:02:59 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Creating image(s)
Nov 09 02:02:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "/opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "/opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "/opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "fd0aae8794503ef9345e20e7be1940ba98e09ccc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "fd0aae8794503ef9345e20e7be1940ba98e09ccc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:02:59 user nova-compute[75438]: DEBUG nova.policy [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9741464b46944a68b510022a306637e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b418d1a5990241ad943b90cb6c306f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-dcbaf534-1894-4690-8f83-b8746687fcaf req-2dbc1afa-8ab7-4420-bc42-9095b5755575 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dcbaf534-1894-4690-8f83-b8746687fcaf req-2dbc1afa-8ab7-4420-bc42-9095b5755575 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dcbaf534-1894-4690-8f83-b8746687fcaf req-2dbc1afa-8ab7-4420-bc42-9095b5755575 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dcbaf534-1894-4690-8f83-b8746687fcaf req-2dbc1afa-8ab7-4420-bc42-9095b5755575 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-dcbaf534-1894-4690-8f83-b8746687fcaf req-2dbc1afa-8ab7-4420-bc42-9095b5755575 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:00 user nova-compute[75438]: WARNING nova.compute.manager [req-dcbaf534-1894-4690-8f83-b8746687fcaf req-2dbc1afa-8ab7-4420-bc42-9095b5755575 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state active and task_state None.
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.part --force-share --output=json" returned: 0 in 0.250s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG nova.virt.images [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] b575526e-a3f5-4629-992e-8e7eb36cc116 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.part /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.part /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.converted" returned: 0 in 0.306s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc.converted --force-share --output=json" returned: 0 in 0.276s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "fd0aae8794503ef9345e20e7be1940ba98e09ccc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.516s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc --force-share --output=json" returned: 0 in 0.276s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "fd0aae8794503ef9345e20e7be1940ba98e09ccc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "fd0aae8794503ef9345e20e7be1940ba98e09ccc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc --force-share --output=json" returned: 0 in 0.300s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc,backing_fmt=raw /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc,backing_fmt=raw /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk 1073741824" returned: 0 in 0.120s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "fd0aae8794503ef9345e20e7be1940ba98e09ccc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Successfully created port: edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc --force-share --output=json" returned: 0 in 0.307s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-e4b8db58-38a1-4ca9-8f74-349b5acd56af req-e39e7fcf-c320-418b-9766-6972c2f7dcf8 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e4b8db58-38a1-4ca9-8f74-349b5acd56af req-e39e7fcf-c320-418b-9766-6972c2f7dcf8 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e4b8db58-38a1-4ca9-8f74-349b5acd56af req-e39e7fcf-c320-418b-9766-6972c2f7dcf8 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e4b8db58-38a1-4ca9-8f74-349b5acd56af req-e39e7fcf-c320-418b-9766-6972c2f7dcf8 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-e4b8db58-38a1-4ca9-8f74-349b5acd56af req-e39e7fcf-c320-418b-9766-6972c2f7dcf8 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:02 user nova-compute[75438]: WARNING nova.compute.manager [req-e4b8db58-38a1-4ca9-8f74-349b5acd56af req-e39e7fcf-c320-418b-9766-6972c2f7dcf8 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state active and task_state None.
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Cannot resize image /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Ensure instance console log exists: /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Successfully updated port: edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:03:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquired lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:03:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.network.neutron [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updating instance_info_cache with network_info: [{"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Releasing lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Instance network_info: |[{"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Start _get_guest_xml network_info=[{"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T02:02:47Z,direct_url=<?>,disk_format='qcow2',id=b575526e-a3f5-4629-992e-8e7eb36cc116,min_disk=0,min_ram=0,name='',owner='d61fb7acd61b443cbccc0599dd477fdc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T02:02:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/sda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'image_id': 'b575526e-a3f5-4629-992e-8e7eb36cc116'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:03:04 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:04 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T02:02:47Z,direct_url=<?>,disk_format='qcow2',id=b575526e-a3f5-4629-992e-8e7eb36cc116,min_disk=0,min_ram=0,name='',owner='d61fb7acd61b443cbccc0599dd477fdc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T02:02:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-798063300',display_name='tempest-AttachSCSIVolumeTestJSON-server-798063300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-798063300',id=6,image_ref='b575526e-a3f5-4629-992e-8e7eb36cc116',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs/orgcrP+ZrNok4mnlONEq2NUGZwZm3v/MLXn12w+LrMtFtove00vqXVrRXsoDr3RJ6S28D5EOY9ivZZX8ZMxBsZEXi1AgCUwxvyrZT4E6H0kyWdtG45VfZA1T1A8ALQ==',key_name='tempest-keypair-1488121515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b418d1a5990241ad943b90cb6c306f6e',ramdisk_id='',reservation_id='r-7ushs25u',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b575526e-a3f5-4629-992e-8e7eb36cc116',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-741934769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-741934769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741464b46944a68b510022a306637e8',uuid=5148fd3c-cf19-4108-bcf2-7ef96368cbc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Converting VIF {"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.objects.instance [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lazy-loading 'pci_devices' on Instance uuid 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:03:04 user nova-compute[75438]:   <uuid>5148fd3c-cf19-4108-bcf2-7ef96368cbc5</uuid>
Nov 09 02:03:04 user nova-compute[75438]:   <name>instance-00000006</name>
Nov 09 02:03:04 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:03:04 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:03:04 user nova-compute[75438]:   <metadata>
Nov 09 02:03:04 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:03:04 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:03:04 user nova-compute[75438]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-798063300</nova:name>
Nov 09 02:03:04 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:03:04</nova:creationTime>
Nov 09 02:03:04 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:03:04 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:03:04 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:03:04 user nova-compute[75438]:       <nova:owner>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:user uuid="9741464b46944a68b510022a306637e8">tempest-AttachSCSIVolumeTestJSON-741934769-project-member</nova:user>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:project uuid="b418d1a5990241ad943b90cb6c306f6e">tempest-AttachSCSIVolumeTestJSON-741934769</nova:project>
Nov 09 02:03:04 user nova-compute[75438]:       </nova:owner>
Nov 09 02:03:04 user nova-compute[75438]:       <nova:root type="image" uuid="b575526e-a3f5-4629-992e-8e7eb36cc116"/>
Nov 09 02:03:04 user nova-compute[75438]:       <nova:ports>
Nov 09 02:03:04 user nova-compute[75438]:         <nova:port uuid="edbd4134-fb45-4bf8-9b11-b1a854c81151">
Nov 09 02:03:04 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 02:03:04 user nova-compute[75438]:         </nova:port>
Nov 09 02:03:04 user nova-compute[75438]:       </nova:ports>
Nov 09 02:03:04 user nova-compute[75438]:     </nova:instance>
Nov 09 02:03:04 user nova-compute[75438]:   </metadata>
Nov 09 02:03:04 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:03:04 user nova-compute[75438]:     <system>
Nov 09 02:03:04 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:03:04 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:03:04 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:03:04 user nova-compute[75438]:       <entry name="serial">5148fd3c-cf19-4108-bcf2-7ef96368cbc5</entry>
Nov 09 02:03:04 user nova-compute[75438]:       <entry name="uuid">5148fd3c-cf19-4108-bcf2-7ef96368cbc5</entry>
Nov 09 02:03:04 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:03:04 user nova-compute[75438]:     </system>
Nov 09 02:03:04 user nova-compute[75438]:   </sysinfo>
Nov 09 02:03:04 user nova-compute[75438]:   <os>
Nov 09 02:03:04 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:03:04 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:03:04 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:03:04 user nova-compute[75438]:   </os>
Nov 09 02:03:04 user nova-compute[75438]:   <features>
Nov 09 02:03:04 user nova-compute[75438]:     <acpi/>
Nov 09 02:03:04 user nova-compute[75438]:     <apic/>
Nov 09 02:03:04 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:03:04 user nova-compute[75438]:   </features>
Nov 09 02:03:04 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:03:04 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:03:04 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:03:04 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:03:04 user nova-compute[75438]:   </clock>
Nov 09 02:03:04 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:03:04 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:03:04 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:03:04 user nova-compute[75438]:   </cpu>
Nov 09 02:03:04 user nova-compute[75438]:   <devices>
Nov 09 02:03:04 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:03:04 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:03:04 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk"/>
Nov 09 02:03:04 user nova-compute[75438]:       <target dev="sda" bus="scsi"/>
Nov 09 02:03:04 user nova-compute[75438]:       <address type="drive" controller="0" unit="0"/>
Nov 09 02:03:04 user nova-compute[75438]:     </disk>
Nov 09 02:03:04 user nova-compute[75438]:     <disk type="file" device="cdrom">
Nov 09 02:03:04 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 02:03:04 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.config"/>
Nov 09 02:03:04 user nova-compute[75438]:       <target dev="sdb" bus="scsi"/>
Nov 09 02:03:04 user nova-compute[75438]:       <address type="drive" controller="0" unit="1"/>
Nov 09 02:03:04 user nova-compute[75438]:     </disk>
Nov 09 02:03:04 user nova-compute[75438]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 09 02:03:04 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:03:04 user nova-compute[75438]:       <mac address="fa:16:3e:4e:e9:01"/>
Nov 09 02:03:04 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:04 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:03:04 user nova-compute[75438]:       <target dev="tapedbd4134-fb"/>
Nov 09 02:03:04 user nova-compute[75438]:     </interface>
Nov 09 02:03:04 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:03:04 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/console.log" append="off"/>
Nov 09 02:03:04 user nova-compute[75438]:     </serial>
Nov 09 02:03:04 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:03:04 user nova-compute[75438]:     <video>
Nov 09 02:03:04 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:04 user nova-compute[75438]:     </video>
Nov 09 02:03:04 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:03:04 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:03:04 user nova-compute[75438]:     </rng>
Nov 09 02:03:04 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:03:04 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:03:04 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:03:04 user nova-compute[75438]:     </memballoon>
Nov 09 02:03:04 user nova-compute[75438]:   </devices>
Nov 09 02:03:04 user nova-compute[75438]: </domain>
Nov 09 02:03:04 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-798063300',display_name='tempest-AttachSCSIVolumeTestJSON-server-798063300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-798063300',id=6,image_ref='b575526e-a3f5-4629-992e-8e7eb36cc116',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs/orgcrP+ZrNok4mnlONEq2NUGZwZm3v/MLXn12w+LrMtFtove00vqXVrRXsoDr3RJ6S28D5EOY9ivZZX8ZMxBsZEXi1AgCUwxvyrZT4E6H0kyWdtG45VfZA1T1A8ALQ==',key_name='tempest-keypair-1488121515',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b418d1a5990241ad943b90cb6c306f6e',ramdisk_id='',reservation_id='r-7ushs25u',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b575526e-a3f5-4629-992e-8e7eb36cc116',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-741934769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-741934769-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741464b46944a68b510022a306637e8',uuid=5148fd3c-cf19-4108-bcf2-7ef96368cbc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Converting VIF {"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG os_vif [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b215240d-6f00-5010-8112-373daab5c0d2', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedbd4134-fb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedbd4134-fb, col_values=(('qos', UUID('932d7af4-b26b-41a6-bf9e-970d9a61468f')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedbd4134-fb, col_values=(('external_ids', {'iface-id': 'edbd4134-fb45-4bf8-9b11-b1a854c81151', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:e9:01', 'vm-uuid': '5148fd3c-cf19-4108-bcf2-7ef96368cbc5'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: INFO os_vif [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb')
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No BDM found with device name sda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No VIF found with MAC fa:16:3e:4e:e9:01, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:03:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Using config drive
Nov 09 02:03:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Creating config drive at /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.config
Nov 09 02:03:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpip0vn_c4 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpip0vn_c4" returned: 0 in 0.061s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-changed-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Refreshing instance network info cache due to event network-changed-edbd4134-fb45-4bf8-9b11-b1a854c81151. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] Acquiring lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] Acquired lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Refreshing network info cache for port edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG nova.network.neutron [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updated VIF entry in instance network info cache for port edbd4134-fb45-4bf8-9b11-b1a854c81151. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG nova.network.neutron [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updating instance_info_cache with network_info: [{"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8580e72c-409b-4f6d-9cb6-b309797ba463 req-a5cd3923-6f8a-432b-885c-3202f4024cc9 service nova] Releasing lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:05 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:03:05 user nova-compute[75438]: INFO nova.compute.claims [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Claim successful on node user
Nov 09 02:03:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.590s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.network.neutron [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:03:06 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.policy [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f67183f87b54ac79256ea3fc01744c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85ebb6bddc26465a9a4257132c4bf0aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:03:06 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Creating image(s)
Nov 09 02:03:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "/opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "/opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "/opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.282s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk 1073741824" returned: 0 in 0.066s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.249s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Successfully created port: 72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Cannot resize image /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Ensure instance console log exists: /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:03:08 user nova-compute[75438]: INFO nova.compute.claims [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Claim successful on node user
Nov 09 02:03:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e31b109-fdf4-4ba2-bb25-02965e938f18 req-31631023-ac76-42d4-89cd-92b55bf3c6d2 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e31b109-fdf4-4ba2-bb25-02965e938f18 req-31631023-ac76-42d4-89cd-92b55bf3c6d2 service nova] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e31b109-fdf4-4ba2-bb25-02965e938f18 req-31631023-ac76-42d4-89cd-92b55bf3c6d2 service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e31b109-fdf4-4ba2-bb25-02965e938f18 req-31631023-ac76-42d4-89cd-92b55bf3c6d2 service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e31b109-fdf4-4ba2-bb25-02965e938f18 req-31631023-ac76-42d4-89cd-92b55bf3c6d2 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] No waiting events found dispatching network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:08 user nova-compute[75438]: WARNING nova.compute.manager [req-4e31b109-fdf4-4ba2-bb25-02965e938f18 req-31631023-ac76-42d4-89cd-92b55bf3c6d2 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received unexpected event network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 for instance with vm_state building and task_state spawning.
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Successfully updated port: 72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquired lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:03:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Instance spawned successfully.
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.839s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:03:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:03:09 user nova-compute[75438]: INFO nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Took 9.67 seconds to spawn the instance on the hypervisor.
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: INFO nova.compute.manager [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Took 11.17 seconds to build instance.
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-13a6d0b3-b682-4dfd-817c-0afb76eab459 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.385s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:03:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Creating image(s)
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.policy [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '465ad518561a4635835ffe05296b0d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c16810f93a475abcee4b697a8019bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-192c8dc0-06a7-48d0-b430-2888232b7da5 req-b59807c8-2994-4398-afc6-af5f765742cc service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-192c8dc0-06a7-48d0-b430-2888232b7da5 req-b59807c8-2994-4398-afc6-af5f765742cc service nova] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-192c8dc0-06a7-48d0-b430-2888232b7da5 req-b59807c8-2994-4398-afc6-af5f765742cc service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-192c8dc0-06a7-48d0-b430-2888232b7da5 req-b59807c8-2994-4398-afc6-af5f765742cc service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-192c8dc0-06a7-48d0-b430-2888232b7da5 req-b59807c8-2994-4398-afc6-af5f765742cc service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] No waiting events found dispatching network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:09 user nova-compute[75438]: WARNING nova.compute.manager [req-192c8dc0-06a7-48d0-b430-2888232b7da5 req-b59807c8-2994-4398-afc6-af5f765742cc service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received unexpected event network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e for instance with vm_state active and task_state None.
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating instance_info_cache with network_info: [{"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Releasing lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Instance network_info: |[{"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Start _get_guest_xml network_info=[{"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:03:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1445481304',display_name='tempest-TestVolumeSwap-server-1445481304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1445481304',id=7,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa5BbppXwXFUbgfscdBgd3UtwPgMvKvDxVn0DPJQaf+LfGLVmgeA6rVFMIF0lkezSrDCLD+Mp5Hl0VQn7HP6vw63O5GsWOMfc9go2ctj0KT+ympMbudTZkUgb09z2uXgg==',key_name='tempest-keypair-301964538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ebb6bddc26465a9a4257132c4bf0aa',ramdisk_id='',reservation_id='r-5o9q4b0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1441210545',owner_user_name='tempest-TestVolumeSwap-1441210545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f67183f87b54ac79256ea3fc01744c5',uuid=58220e40-bfca-4be5-a3af-d1011f77e1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Converting VIF {"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.objects.instance [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lazy-loading 'pci_devices' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:03:09 user nova-compute[75438]:   <uuid>58220e40-bfca-4be5-a3af-d1011f77e1a8</uuid>
Nov 09 02:03:09 user nova-compute[75438]:   <name>instance-00000007</name>
Nov 09 02:03:09 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:03:09 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:03:09 user nova-compute[75438]:   <metadata>
Nov 09 02:03:09 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:03:09 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:03:09 user nova-compute[75438]:       <nova:name>tempest-TestVolumeSwap-server-1445481304</nova:name>
Nov 09 02:03:09 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:03:09</nova:creationTime>
Nov 09 02:03:09 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:03:09 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:03:09 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:03:09 user nova-compute[75438]:       <nova:owner>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:user uuid="7f67183f87b54ac79256ea3fc01744c5">tempest-TestVolumeSwap-1441210545-project-member</nova:user>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:project uuid="85ebb6bddc26465a9a4257132c4bf0aa">tempest-TestVolumeSwap-1441210545</nova:project>
Nov 09 02:03:09 user nova-compute[75438]:       </nova:owner>
Nov 09 02:03:09 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:03:09 user nova-compute[75438]:       <nova:ports>
Nov 09 02:03:09 user nova-compute[75438]:         <nova:port uuid="72486962-8dbd-4bd1-99d3-14bf7a29caa3">
Nov 09 02:03:09 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:03:09 user nova-compute[75438]:         </nova:port>
Nov 09 02:03:09 user nova-compute[75438]:       </nova:ports>
Nov 09 02:03:09 user nova-compute[75438]:     </nova:instance>
Nov 09 02:03:09 user nova-compute[75438]:   </metadata>
Nov 09 02:03:09 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:03:09 user nova-compute[75438]:     <system>
Nov 09 02:03:09 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:03:09 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:03:09 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:03:09 user nova-compute[75438]:       <entry name="serial">58220e40-bfca-4be5-a3af-d1011f77e1a8</entry>
Nov 09 02:03:09 user nova-compute[75438]:       <entry name="uuid">58220e40-bfca-4be5-a3af-d1011f77e1a8</entry>
Nov 09 02:03:09 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:03:09 user nova-compute[75438]:     </system>
Nov 09 02:03:09 user nova-compute[75438]:   </sysinfo>
Nov 09 02:03:09 user nova-compute[75438]:   <os>
Nov 09 02:03:09 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:03:09 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:03:09 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:03:09 user nova-compute[75438]:   </os>
Nov 09 02:03:09 user nova-compute[75438]:   <features>
Nov 09 02:03:09 user nova-compute[75438]:     <acpi/>
Nov 09 02:03:09 user nova-compute[75438]:     <apic/>
Nov 09 02:03:09 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:03:09 user nova-compute[75438]:   </features>
Nov 09 02:03:09 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:03:09 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:03:09 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:03:09 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:03:09 user nova-compute[75438]:   </clock>
Nov 09 02:03:09 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:03:09 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:03:09 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:03:09 user nova-compute[75438]:   </cpu>
Nov 09 02:03:09 user nova-compute[75438]:   <devices>
Nov 09 02:03:09 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:03:09 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:03:09 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk"/>
Nov 09 02:03:09 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:03:09 user nova-compute[75438]:     </disk>
Nov 09 02:03:09 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:03:09 user nova-compute[75438]:       <mac address="fa:16:3e:86:01:22"/>
Nov 09 02:03:09 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:09 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:03:09 user nova-compute[75438]:       <target dev="tap72486962-8d"/>
Nov 09 02:03:09 user nova-compute[75438]:     </interface>
Nov 09 02:03:09 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:03:09 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/console.log" append="off"/>
Nov 09 02:03:09 user nova-compute[75438]:     </serial>
Nov 09 02:03:09 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:03:09 user nova-compute[75438]:     <video>
Nov 09 02:03:09 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:09 user nova-compute[75438]:     </video>
Nov 09 02:03:09 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:03:09 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:03:09 user nova-compute[75438]:     </rng>
Nov 09 02:03:09 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:03:09 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:03:09 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:03:09 user nova-compute[75438]:     </memballoon>
Nov 09 02:03:09 user nova-compute[75438]:   </devices>
Nov 09 02:03:09 user nova-compute[75438]: </domain>
Nov 09 02:03:09 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1445481304',display_name='tempest-TestVolumeSwap-server-1445481304',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1445481304',id=7,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa5BbppXwXFUbgfscdBgd3UtwPgMvKvDxVn0DPJQaf+LfGLVmgeA6rVFMIF0lkezSrDCLD+Mp5Hl0VQn7HP6vw63O5GsWOMfc9go2ctj0KT+ympMbudTZkUgb09z2uXgg==',key_name='tempest-keypair-301964538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='85ebb6bddc26465a9a4257132c4bf0aa',ramdisk_id='',reservation_id='r-5o9q4b0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1441210545',owner_user_name='tempest-TestVolumeSwap-1441210545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f67183f87b54ac79256ea3fc01744c5',uuid=58220e40-bfca-4be5-a3af-d1011f77e1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Converting VIF {"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG os_vif [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5904025a-4f25-5a01-a944-bb057698695e', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk 1073741824" returned: 0 in 0.070s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72486962-8d, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72486962-8d, col_values=(('qos', UUID('66db3d17-6f56-4d51-8a08-200044f7f4e7')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72486962-8d, col_values=(('external_ids', {'iface-id': '72486962-8dbd-4bd1-99d3-14bf7a29caa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:01:22', 'vm-uuid': '58220e40-bfca-4be5-a3af-d1011f77e1a8'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:09 user nova-compute[75438]: INFO os_vif [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d')
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] No VIF found with MAC fa:16:3e:86:01:22, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.247s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Cannot resize image /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Ensure instance console log exists: /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-changed-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Refreshing instance network info cache due to event network-changed-72486962-8dbd-4bd1-99d3-14bf7a29caa3. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] Acquiring lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] Acquired lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Refreshing network info cache for port 72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updated VIF entry in instance network info cache for port 72486962-8dbd-4bd1-99d3-14bf7a29caa3. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating instance_info_cache with network_info: [{"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] Releasing lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] No waiting events found dispatching network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:11 user nova-compute[75438]: WARNING nova.compute.manager [req-6a8ebd93-d2b7-4bdd-980a-7622ee6de584 req-7c4e9630-ffec-4d4c-af6d-9f4bf48c5d80 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received unexpected event network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 for instance with vm_state active and task_state None.
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:03:11 user nova-compute[75438]: INFO nova.compute.claims [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Claim successful on node user
Nov 09 02:03:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-dd3605bb-89e6-4b58-90ec-512d4f518955 req-e2a12c6a-341f-4175-8904-5e593a5cedba service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dd3605bb-89e6-4b58-90ec-512d4f518955 req-e2a12c6a-341f-4175-8904-5e593a5cedba service nova] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dd3605bb-89e6-4b58-90ec-512d4f518955 req-e2a12c6a-341f-4175-8904-5e593a5cedba service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dd3605bb-89e6-4b58-90ec-512d4f518955 req-e2a12c6a-341f-4175-8904-5e593a5cedba service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-dd3605bb-89e6-4b58-90ec-512d4f518955 req-e2a12c6a-341f-4175-8904-5e593a5cedba service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] No waiting events found dispatching network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:11 user nova-compute[75438]: WARNING nova.compute.manager [req-dd3605bb-89e6-4b58-90ec-512d4f518955 req-e2a12c6a-341f-4175-8904-5e593a5cedba service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received unexpected event network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e for instance with vm_state active and task_state None.
Nov 09 02:03:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.network.neutron [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Successfully created port: c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.822s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:03:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.policy [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fb47b3c0ad040e7ba5a7673a3f7b47e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d525170e244da985aed014bb19d2dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:03:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Creating image(s)
Nov 09 02:03:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "/opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "/opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "/opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.222s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk 1073741824" returned: 0 in 0.059s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Successfully created port: 608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:14 user nova-compute[75438]: WARNING nova.compute.manager [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state active and task_state None.
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:14 user nova-compute[75438]: WARNING nova.compute.manager [req-e3875960-418c-47a2-addc-73547b45876a req-a3acdd76-f941-42a9-9f39-24f595d5b9cd service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state active and task_state None.
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.414s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Cannot resize image /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Ensure instance console log exists: /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Successfully updated port: c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquired lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Releasing lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Instance network_info: |[{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Start _get_guest_xml network_info=[{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:03:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:14 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.objects.instance [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'pci_devices' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Successfully updated port: 608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquired lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:03:14 user nova-compute[75438]:   <uuid>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</uuid>
Nov 09 02:03:14 user nova-compute[75438]:   <name>instance-00000008</name>
Nov 09 02:03:14 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:03:14 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:03:14 user nova-compute[75438]:   <metadata>
Nov 09 02:03:14 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:03:14 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:03:14 user nova-compute[75438]:       <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:03:14 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:03:14</nova:creationTime>
Nov 09 02:03:14 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:03:14 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:03:14 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:03:14 user nova-compute[75438]:       <nova:owner>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:03:14 user nova-compute[75438]:       </nova:owner>
Nov 09 02:03:14 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:03:14 user nova-compute[75438]:       <nova:ports>
Nov 09 02:03:14 user nova-compute[75438]:         <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:03:14 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:03:14 user nova-compute[75438]:         </nova:port>
Nov 09 02:03:14 user nova-compute[75438]:       </nova:ports>
Nov 09 02:03:14 user nova-compute[75438]:     </nova:instance>
Nov 09 02:03:14 user nova-compute[75438]:   </metadata>
Nov 09 02:03:14 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:03:14 user nova-compute[75438]:     <system>
Nov 09 02:03:14 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:03:14 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:03:14 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:03:14 user nova-compute[75438]:       <entry name="serial">0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:03:14 user nova-compute[75438]:       <entry name="uuid">0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:03:14 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:03:14 user nova-compute[75438]:     </system>
Nov 09 02:03:14 user nova-compute[75438]:   </sysinfo>
Nov 09 02:03:14 user nova-compute[75438]:   <os>
Nov 09 02:03:14 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:03:14 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:03:14 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:03:14 user nova-compute[75438]:   </os>
Nov 09 02:03:14 user nova-compute[75438]:   <features>
Nov 09 02:03:14 user nova-compute[75438]:     <acpi/>
Nov 09 02:03:14 user nova-compute[75438]:     <apic/>
Nov 09 02:03:14 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:03:14 user nova-compute[75438]:   </features>
Nov 09 02:03:14 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:03:14 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:03:14 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:03:14 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:03:14 user nova-compute[75438]:   </clock>
Nov 09 02:03:14 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:03:14 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:03:14 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:03:14 user nova-compute[75438]:   </cpu>
Nov 09 02:03:14 user nova-compute[75438]:   <devices>
Nov 09 02:03:14 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:03:14 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:03:14 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk"/>
Nov 09 02:03:14 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:03:14 user nova-compute[75438]:     </disk>
Nov 09 02:03:14 user nova-compute[75438]:     <disk type="file" device="cdrom">
Nov 09 02:03:14 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 02:03:14 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config"/>
Nov 09 02:03:14 user nova-compute[75438]:       <target dev="hda" bus="ide"/>
Nov 09 02:03:14 user nova-compute[75438]:     </disk>
Nov 09 02:03:14 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:03:14 user nova-compute[75438]:       <mac address="fa:16:3e:b4:98:b3"/>
Nov 09 02:03:14 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:14 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:03:14 user nova-compute[75438]:       <target dev="tapc29727fb-92"/>
Nov 09 02:03:14 user nova-compute[75438]:     </interface>
Nov 09 02:03:14 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:03:14 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log" append="off"/>
Nov 09 02:03:14 user nova-compute[75438]:     </serial>
Nov 09 02:03:14 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:03:14 user nova-compute[75438]:     <video>
Nov 09 02:03:14 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:14 user nova-compute[75438]:     </video>
Nov 09 02:03:14 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:03:14 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:03:14 user nova-compute[75438]:     </rng>
Nov 09 02:03:14 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:03:14 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:03:14 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:03:14 user nova-compute[75438]:     </memballoon>
Nov 09 02:03:14 user nova-compute[75438]:   </devices>
Nov 09 02:03:14 user nova-compute[75438]: </domain>
Nov 09 02:03:14 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG os_vif [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6654a20f-6ba1-5567-b06d-b0c97ebb03fd', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Instance spawned successfully.
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc29727fb-92, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc29727fb-92, col_values=(('qos', UUID('e93f689d-4ea1-4166-a32a-895a5125c722')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc29727fb-92, col_values=(('external_ids', {'iface-id': 'c29727fb-924a-4912-a60e-c6af7386834e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:98:b3', 'vm-uuid': '0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: INFO os_vif [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92')
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-changed-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Refreshing instance network info cache due to event network-changed-608d3a29-ea2e-4f08-9a14-334873c6f6d6. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] Acquiring lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No BDM found with device name hda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No VIF found with MAC fa:16:3e:b4:98:b3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:03:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Using config drive
Nov 09 02:03:15 user nova-compute[75438]: INFO nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Took 8.21 seconds to spawn the instance on the hypervisor.
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:03:15 user nova-compute[75438]: INFO nova.compute.manager [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Took 9.40 seconds to build instance.
Nov 09 02:03:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Creating config drive at /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdghgx8kc {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dd52c2d4-144a-4ff9-a49b-cbdfd4a2be06 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.731s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdghgx8kc" returned: 0 in 0.058s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updating instance_info_cache with network_info: [{"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Releasing lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Instance network_info: |[{"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] Acquired lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Refreshing network info cache for port 608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Start _get_guest_xml network_info=[{"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:03:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1401710627',display_name='tempest-VolumesAssistedSnapshotsTest-server-1401710627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1401710627',id=9,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ROf8IxEAI0oKR89B7GVoPqsYxu51FHJSKmtMoi5EMN4gvvsN2GIGZsdd1KdpiNQzmA1NGlBVdGpGNP+iCpZi6j5T2vU+RI48Q14JUxMHJidg+j+z7rgn0bJ9jEKw2YQ==',key_name='tempest-keypair-2135722406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1d525170e244da985aed014bb19d2dd',ramdisk_id='',reservation_id='r-xsv9pbao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-549865047',owner_user_name='tempest-VolumesAssistedSnapshotsTest-549865047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fb47b3c0ad040e7ba5a7673a3f7b47e',uuid=02ef8bf0-077e-4653-98f5-9e6fef690fdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Converting VIF {"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lazy-loading 'pci_devices' on Instance uuid 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:03:15 user nova-compute[75438]:   <uuid>02ef8bf0-077e-4653-98f5-9e6fef690fdb</uuid>
Nov 09 02:03:15 user nova-compute[75438]:   <name>instance-00000009</name>
Nov 09 02:03:15 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:03:15 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:03:15 user nova-compute[75438]:   <metadata>
Nov 09 02:03:15 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:03:15 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:03:15 user nova-compute[75438]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1401710627</nova:name>
Nov 09 02:03:15 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:03:15</nova:creationTime>
Nov 09 02:03:15 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:03:15 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:03:15 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:03:15 user nova-compute[75438]:       <nova:owner>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:user uuid="7fb47b3c0ad040e7ba5a7673a3f7b47e">tempest-VolumesAssistedSnapshotsTest-549865047-project-member</nova:user>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:project uuid="f1d525170e244da985aed014bb19d2dd">tempest-VolumesAssistedSnapshotsTest-549865047</nova:project>
Nov 09 02:03:15 user nova-compute[75438]:       </nova:owner>
Nov 09 02:03:15 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:03:15 user nova-compute[75438]:       <nova:ports>
Nov 09 02:03:15 user nova-compute[75438]:         <nova:port uuid="608d3a29-ea2e-4f08-9a14-334873c6f6d6">
Nov 09 02:03:15 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 02:03:15 user nova-compute[75438]:         </nova:port>
Nov 09 02:03:15 user nova-compute[75438]:       </nova:ports>
Nov 09 02:03:15 user nova-compute[75438]:     </nova:instance>
Nov 09 02:03:15 user nova-compute[75438]:   </metadata>
Nov 09 02:03:15 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:03:15 user nova-compute[75438]:     <system>
Nov 09 02:03:15 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:03:15 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:03:15 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:03:15 user nova-compute[75438]:       <entry name="serial">02ef8bf0-077e-4653-98f5-9e6fef690fdb</entry>
Nov 09 02:03:15 user nova-compute[75438]:       <entry name="uuid">02ef8bf0-077e-4653-98f5-9e6fef690fdb</entry>
Nov 09 02:03:15 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:03:15 user nova-compute[75438]:     </system>
Nov 09 02:03:15 user nova-compute[75438]:   </sysinfo>
Nov 09 02:03:15 user nova-compute[75438]:   <os>
Nov 09 02:03:15 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:03:15 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:03:15 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:03:15 user nova-compute[75438]:   </os>
Nov 09 02:03:15 user nova-compute[75438]:   <features>
Nov 09 02:03:15 user nova-compute[75438]:     <acpi/>
Nov 09 02:03:15 user nova-compute[75438]:     <apic/>
Nov 09 02:03:15 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:03:15 user nova-compute[75438]:   </features>
Nov 09 02:03:15 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:03:15 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:03:15 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:03:15 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:03:15 user nova-compute[75438]:   </clock>
Nov 09 02:03:15 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:03:15 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:03:15 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:03:15 user nova-compute[75438]:   </cpu>
Nov 09 02:03:15 user nova-compute[75438]:   <devices>
Nov 09 02:03:15 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:03:15 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:03:15 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk"/>
Nov 09 02:03:15 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:03:15 user nova-compute[75438]:     </disk>
Nov 09 02:03:15 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:03:15 user nova-compute[75438]:       <mac address="fa:16:3e:9e:3d:14"/>
Nov 09 02:03:15 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:15 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:03:15 user nova-compute[75438]:       <target dev="tap608d3a29-ea"/>
Nov 09 02:03:15 user nova-compute[75438]:     </interface>
Nov 09 02:03:15 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:03:15 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/console.log" append="off"/>
Nov 09 02:03:15 user nova-compute[75438]:     </serial>
Nov 09 02:03:15 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:03:15 user nova-compute[75438]:     <video>
Nov 09 02:03:15 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:15 user nova-compute[75438]:     </video>
Nov 09 02:03:15 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:03:15 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:03:15 user nova-compute[75438]:     </rng>
Nov 09 02:03:15 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:03:15 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:03:15 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:03:15 user nova-compute[75438]:     </memballoon>
Nov 09 02:03:15 user nova-compute[75438]:   </devices>
Nov 09 02:03:15 user nova-compute[75438]: </domain>
Nov 09 02:03:15 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1401710627',display_name='tempest-VolumesAssistedSnapshotsTest-server-1401710627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1401710627',id=9,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ROf8IxEAI0oKR89B7GVoPqsYxu51FHJSKmtMoi5EMN4gvvsN2GIGZsdd1KdpiNQzmA1NGlBVdGpGNP+iCpZi6j5T2vU+RI48Q14JUxMHJidg+j+z7rgn0bJ9jEKw2YQ==',key_name='tempest-keypair-2135722406',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1d525170e244da985aed014bb19d2dd',ramdisk_id='',reservation_id='r-xsv9pbao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-549865047',owner_user_name='tempest-VolumesAssistedSnapshotsTest-549865047-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fb47b3c0ad040e7ba5a7673a3f7b47e',uuid=02ef8bf0-077e-4653-98f5-9e6fef690fdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Converting VIF {"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG os_vif [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92288aaa-dd5f-5102-9440-4f5d09d75eb9', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap608d3a29-ea, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap608d3a29-ea, col_values=(('qos', UUID('c8c48b02-9be5-4784-b994-e68524c2740e')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap608d3a29-ea, col_values=(('external_ids', {'iface-id': '608d3a29-ea2e-4f08-9a14-334873c6f6d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:3d:14', 'vm-uuid': '02ef8bf0-077e-4653-98f5-9e6fef690fdb'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:15 user nova-compute[75438]: INFO os_vif [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea')
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] No VIF found with MAC fa:16:3e:9e:3d:14, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-changed-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Refreshing instance network info cache due to event network-changed-c29727fb-924a-4912-a60e-c6af7386834e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] Acquiring lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] Acquired lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.network.neutron [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Refreshing network info cache for port c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.network.neutron [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updated VIF entry in instance network info cache for port 608d3a29-ea2e-4f08-9a14-334873c6f6d6. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.network.neutron [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updating instance_info_cache with network_info: [{"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-15b3b666-012d-4083-8f96-9a5f7b2f1bbc req-7afc0cd7-05e7-402e-9bb5-2f9442585cfd service nova] Releasing lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.network.neutron [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updated VIF entry in instance network info cache for port c29727fb-924a-4912-a60e-c6af7386834e. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.network.neutron [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8b8cc2ab-0e42-478f-847d-94916c6d48df req-3e9adaf2-a078-430b-80a4-468aa2bd3213 service nova] Releasing lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:16 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5c6332c-2def-4eb3-8f2b-0070558265b9 req-234c67e5-ffd2-4067-962e-1d35ea9d1ec7 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5c6332c-2def-4eb3-8f2b-0070558265b9 req-234c67e5-ffd2-4067-962e-1d35ea9d1ec7 service nova] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5c6332c-2def-4eb3-8f2b-0070558265b9 req-234c67e5-ffd2-4067-962e-1d35ea9d1ec7 service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5c6332c-2def-4eb3-8f2b-0070558265b9 req-234c67e5-ffd2-4067-962e-1d35ea9d1ec7 service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5c6332c-2def-4eb3-8f2b-0070558265b9 req-234c67e5-ffd2-4067-962e-1d35ea9d1ec7 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] No waiting events found dispatching network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:18 user nova-compute[75438]: WARNING nova.compute.manager [req-f5c6332c-2def-4eb3-8f2b-0070558265b9 req-234c67e5-ffd2-4067-962e-1d35ea9d1ec7 service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received unexpected event network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 for instance with vm_state active and task_state None.
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-77a297e5-6592-4550-a2fc-9655590e2c1b req-5397d4ed-f311-4855-ba54-a86a363c0463 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-77a297e5-6592-4550-a2fc-9655590e2c1b req-5397d4ed-f311-4855-ba54-a86a363c0463 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-77a297e5-6592-4550-a2fc-9655590e2c1b req-5397d4ed-f311-4855-ba54-a86a363c0463 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-77a297e5-6592-4550-a2fc-9655590e2c1b req-5397d4ed-f311-4855-ba54-a86a363c0463 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-77a297e5-6592-4550-a2fc-9655590e2c1b req-5397d4ed-f311-4855-ba54-a86a363c0463 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:20 user nova-compute[75438]: WARNING nova.compute.manager [req-77a297e5-6592-4550-a2fc-9655590e2c1b req-5397d4ed-f311-4855-ba54-a86a363c0463 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e for instance with vm_state building and task_state spawning.
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] No waiting events found dispatching network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:20 user nova-compute[75438]: WARNING nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received unexpected event network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 for instance with vm_state active and task_state None.
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] No waiting events found dispatching network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:20 user nova-compute[75438]: WARNING nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received unexpected event network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 for instance with vm_state building and task_state spawning.
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] No waiting events found dispatching network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:20 user nova-compute[75438]: WARNING nova.compute.manager [req-7c05973a-36c5-4773-86d4-2fcb1d52e12d req-f56d40bb-8a18-415c-83f3-255b5bfa569f service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received unexpected event network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 for instance with vm_state building and task_state spawning.
Nov 09 02:03:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Instance spawned successfully.
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:03:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Instance spawned successfully.
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:21 user nova-compute[75438]: INFO nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Took 12.50 seconds to spawn the instance on the hypervisor.
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:03:21 user nova-compute[75438]: INFO nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Took 9.07 seconds to spawn the instance on the hypervisor.
Nov 09 02:03:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:03:22 user nova-compute[75438]: INFO nova.compute.manager [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Took 13.82 seconds to build instance.
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-091a2381-c2e1-4455-bf5b-f6d335ddaa29 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.023s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:22 user nova-compute[75438]: INFO nova.compute.manager [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Took 10.72 seconds to build instance.
Nov 09 02:03:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-afe059d4-d7dd-499a-b748-1f4461fa6cbb req-e7920505-30f8-4cce-8b37-73b8cfb9d279 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-afe059d4-d7dd-499a-b748-1f4461fa6cbb req-e7920505-30f8-4cce-8b37-73b8cfb9d279 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-afe059d4-d7dd-499a-b748-1f4461fa6cbb req-e7920505-30f8-4cce-8b37-73b8cfb9d279 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-afe059d4-d7dd-499a-b748-1f4461fa6cbb req-e7920505-30f8-4cce-8b37-73b8cfb9d279 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-afe059d4-d7dd-499a-b748-1f4461fa6cbb req-e7920505-30f8-4cce-8b37-73b8cfb9d279 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:22 user nova-compute[75438]: WARNING nova.compute.manager [req-afe059d4-d7dd-499a-b748-1f4461fa6cbb req-e7920505-30f8-4cce-8b37-73b8cfb9d279 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e for instance with vm_state active and task_state None.
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3aa97298-fbb3-4afe-87f0-6b359c782a1c tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.915s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:03:23 user nova-compute[75438]: INFO nova.compute.claims [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Claim successful on node user
Nov 09 02:03:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.43277359008789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:03:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.234s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.690s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:03:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.policy [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d6befd4ed334e93a1eadae158847415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da4c47781ed4ae8ade5c4e0921cde0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ad38be13-18b6-4de6-b28a-fa027946d63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 1ba28925-aff6-48f5-a4c9-8498efc7c809 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:03:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Creating image(s)
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "/opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "/opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Successfully created port: 0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.293s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.011s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk 1073741824" returned: 0 in 0.062s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Cannot resize image /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Ensure instance console log exists: /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Successfully updated port: 0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-changed-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Refreshing instance network info cache due to event network-changed-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] Acquiring lock "refresh_cache-ad38be13-18b6-4de6-b28a-fa027946d63c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] Acquired lock "refresh_cache-ad38be13-18b6-4de6-b28a-fa027946d63c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Refreshing network info cache for port 0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "refresh_cache-ad38be13-18b6-4de6-b28a-fa027946d63c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Skipping network cache update for instance because it is Building. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 1ba28925-aff6-48f5-a4c9-8498efc7c809 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ef20d58a-d199-4549-b969-03858c58f9ff req-2e13978a-1861-4f3a-a829-c88f27349e2d service nova] Releasing lock "refresh_cache-ad38be13-18b6-4de6-b28a-fa027946d63c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquired lock "refresh_cache-ad38be13-18b6-4de6-b28a-fa027946d63c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Updating instance_info_cache with network_info: [{"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Releasing lock "refresh_cache-ad38be13-18b6-4de6-b28a-fa027946d63c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Instance network_info: |[{"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Start _get_guest_xml network_info=[{"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:03:27 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:27 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1440977857',display_name='tempest-VolumesActionsTest-instance-1440977857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1440977857',id=10,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2da4c47781ed4ae8ade5c4e0921cde0a',ramdisk_id='',reservation_id='r-a0s0j0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-721255364',owner_user_name='tempest-VolumesActionsTest-721255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:26Z,user_data=None,user_id='3d6befd4ed334e93a1eadae158847415',uuid=ad38be13-18b6-4de6-b28a-fa027946d63c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Converting VIF {"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lazy-loading 'pci_devices' on Instance uuid ad38be13-18b6-4de6-b28a-fa027946d63c {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:03:28 user nova-compute[75438]:   <uuid>ad38be13-18b6-4de6-b28a-fa027946d63c</uuid>
Nov 09 02:03:28 user nova-compute[75438]:   <name>instance-0000000a</name>
Nov 09 02:03:28 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:03:28 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:03:28 user nova-compute[75438]:   <metadata>
Nov 09 02:03:28 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:03:28 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:03:28 user nova-compute[75438]:       <nova:name>tempest-VolumesActionsTest-instance-1440977857</nova:name>
Nov 09 02:03:28 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:03:27</nova:creationTime>
Nov 09 02:03:28 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:03:28 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:03:28 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:03:28 user nova-compute[75438]:       <nova:owner>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:user uuid="3d6befd4ed334e93a1eadae158847415">tempest-VolumesActionsTest-721255364-project-member</nova:user>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:project uuid="2da4c47781ed4ae8ade5c4e0921cde0a">tempest-VolumesActionsTest-721255364</nova:project>
Nov 09 02:03:28 user nova-compute[75438]:       </nova:owner>
Nov 09 02:03:28 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:03:28 user nova-compute[75438]:       <nova:ports>
Nov 09 02:03:28 user nova-compute[75438]:         <nova:port uuid="0ad4d0bd-1c1b-43cf-800e-c62858fa97b9">
Nov 09 02:03:28 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:03:28 user nova-compute[75438]:         </nova:port>
Nov 09 02:03:28 user nova-compute[75438]:       </nova:ports>
Nov 09 02:03:28 user nova-compute[75438]:     </nova:instance>
Nov 09 02:03:28 user nova-compute[75438]:   </metadata>
Nov 09 02:03:28 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:03:28 user nova-compute[75438]:     <system>
Nov 09 02:03:28 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:03:28 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:03:28 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:03:28 user nova-compute[75438]:       <entry name="serial">ad38be13-18b6-4de6-b28a-fa027946d63c</entry>
Nov 09 02:03:28 user nova-compute[75438]:       <entry name="uuid">ad38be13-18b6-4de6-b28a-fa027946d63c</entry>
Nov 09 02:03:28 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:03:28 user nova-compute[75438]:     </system>
Nov 09 02:03:28 user nova-compute[75438]:   </sysinfo>
Nov 09 02:03:28 user nova-compute[75438]:   <os>
Nov 09 02:03:28 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:03:28 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:03:28 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:03:28 user nova-compute[75438]:   </os>
Nov 09 02:03:28 user nova-compute[75438]:   <features>
Nov 09 02:03:28 user nova-compute[75438]:     <acpi/>
Nov 09 02:03:28 user nova-compute[75438]:     <apic/>
Nov 09 02:03:28 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:03:28 user nova-compute[75438]:   </features>
Nov 09 02:03:28 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:03:28 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:03:28 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:03:28 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:03:28 user nova-compute[75438]:   </clock>
Nov 09 02:03:28 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:03:28 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:03:28 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:03:28 user nova-compute[75438]:   </cpu>
Nov 09 02:03:28 user nova-compute[75438]:   <devices>
Nov 09 02:03:28 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:03:28 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:03:28 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk"/>
Nov 09 02:03:28 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:03:28 user nova-compute[75438]:     </disk>
Nov 09 02:03:28 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:03:28 user nova-compute[75438]:       <mac address="fa:16:3e:97:f3:76"/>
Nov 09 02:03:28 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:28 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:03:28 user nova-compute[75438]:       <target dev="tap0ad4d0bd-1c"/>
Nov 09 02:03:28 user nova-compute[75438]:     </interface>
Nov 09 02:03:28 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:03:28 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/console.log" append="off"/>
Nov 09 02:03:28 user nova-compute[75438]:     </serial>
Nov 09 02:03:28 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:03:28 user nova-compute[75438]:     <video>
Nov 09 02:03:28 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:03:28 user nova-compute[75438]:     </video>
Nov 09 02:03:28 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:03:28 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:03:28 user nova-compute[75438]:     </rng>
Nov 09 02:03:28 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:03:28 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:03:28 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:03:28 user nova-compute[75438]:     </memballoon>
Nov 09 02:03:28 user nova-compute[75438]:   </devices>
Nov 09 02:03:28 user nova-compute[75438]: </domain>
Nov 09 02:03:28 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1440977857',display_name='tempest-VolumesActionsTest-instance-1440977857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1440977857',id=10,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2da4c47781ed4ae8ade5c4e0921cde0a',ramdisk_id='',reservation_id='r-a0s0j0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-721255364',owner_user_name='tempest-VolumesActionsTest-721255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:03:26Z,user_data=None,user_id='3d6befd4ed334e93a1eadae158847415',uuid=ad38be13-18b6-4de6-b28a-fa027946d63c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Converting VIF {"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG os_vif [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfd334fa-c89e-5f03-8356-6abfc88a71d3', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ad4d0bd-1c, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ad4d0bd-1c, col_values=(('qos', UUID('dcd8c1c0-20ce-4e9b-9ce0-0ea2b88d4cf2')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ad4d0bd-1c, col_values=(('external_ids', {'iface-id': '0ad4d0bd-1c1b-43cf-800e-c62858fa97b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:f3:76', 'vm-uuid': 'ad38be13-18b6-4de6-b28a-fa027946d63c'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:28 user nova-compute[75438]: INFO os_vif [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c')
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updating instance_info_cache with network_info: [{"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-1ba28925-aff6-48f5-a4c9-8498efc7c809" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:03:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] No VIF found with MAC fa:16:3e:97:f3:76, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-4bff9910-c017-4f20-b02e-b6ac7efa4631 req-473d6d2d-fd78-4747-856d-3adcd7dc17a9 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4bff9910-c017-4f20-b02e-b6ac7efa4631 req-473d6d2d-fd78-4747-856d-3adcd7dc17a9 service nova] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4bff9910-c017-4f20-b02e-b6ac7efa4631 req-473d6d2d-fd78-4747-856d-3adcd7dc17a9 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4bff9910-c017-4f20-b02e-b6ac7efa4631 req-473d6d2d-fd78-4747-856d-3adcd7dc17a9 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-4bff9910-c017-4f20-b02e-b6ac7efa4631 req-473d6d2d-fd78-4747-856d-3adcd7dc17a9 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] No waiting events found dispatching network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:29 user nova-compute[75438]: WARNING nova.compute.manager [req-4bff9910-c017-4f20-b02e-b6ac7efa4631 req-473d6d2d-fd78-4747-856d-3adcd7dc17a9 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received unexpected event network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 for instance with vm_state building and task_state spawning.
Nov 09 02:03:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-6e91980a-03fd-48f7-ae60-358b929b2ae7 req-3cdb42dc-cd11-4552-b8eb-66e789ecbca6 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6e91980a-03fd-48f7-ae60-358b929b2ae7 req-3cdb42dc-cd11-4552-b8eb-66e789ecbca6 service nova] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6e91980a-03fd-48f7-ae60-358b929b2ae7 req-3cdb42dc-cd11-4552-b8eb-66e789ecbca6 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6e91980a-03fd-48f7-ae60-358b929b2ae7 req-3cdb42dc-cd11-4552-b8eb-66e789ecbca6 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-6e91980a-03fd-48f7-ae60-358b929b2ae7 req-3cdb42dc-cd11-4552-b8eb-66e789ecbca6 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] No waiting events found dispatching network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:03:31 user nova-compute[75438]: WARNING nova.compute.manager [req-6e91980a-03fd-48f7-ae60-358b929b2ae7 req-3cdb42dc-cd11-4552-b8eb-66e789ecbca6 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received unexpected event network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 for instance with vm_state building and task_state spawning.
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:03:31 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Instance spawned successfully.
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:03:32 user nova-compute[75438]: INFO nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 09 02:03:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:03:32 user nova-compute[75438]: INFO nova.compute.manager [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Took 8.45 seconds to build instance.
Nov 09 02:03:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3556142c-7bd8-43d3-bb06-f96d2d7a4a51 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.610s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:03:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:03:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:04:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:04:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:04:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:04:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:04:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:04:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:04:15 user nova-compute[75438]: INFO nova.compute.claims [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Claim successful on node user
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:04:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:04:16 user nova-compute[75438]: INFO nova.virt.block_device [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Booting with volume d5cce59b-1c51-4e0d-998b-c42781fcc388 at /dev/vda
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.policy [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d48c574bcbe49239ff3d9eedc721b10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3673ddc6f74b73a90c4cb34ec4cebd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG os_brick.utils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:04:16 user nova-compute[75438]: INFO oslo.privsep.daemon [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1jfm6t7c/privsep.sock']
Nov 09 02:04:16 user sudo[87030]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1jfm6t7c/privsep.sock
Nov 09 02:04:16 user sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 09 02:04:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:04:17 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully created port: baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:17 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully created port: 73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:17 user sudo[87030]: pam_unix(sudo:session): session closed for user root
Nov 09 02:04:17 user nova-compute[75438]: INFO oslo.privsep.daemon [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Spawned new privsep daemon via rootwrap
Nov 09 02:04:17 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 09 02:04:17 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 09 02:04:17 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 09 02:04:17 user nova-compute[75438]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87049
Nov 09 02:04:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f8c31-0c2c-4a89-9a05-64f35f30f830]: (2,) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully created port: 7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9fd70-39e5-4c5b-901d-5eb7de2b6cde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:18 user nova-compute[75438]: WARNING os_brick.initiator.connectors.nvmeof [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[33659244-728e-4764-b1bf-a717579e818d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58ce66c-b619-4cb6-90a0-80064731b945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9456771-5eb8-403c-b0f3-37caeec9fe1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:04:18 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[595ca98c-5234-49dc-98c6-7ea502697a22]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG os_brick.utils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== get_connector_properties: return (1751ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating existing volume attachment record: 1788a4d7-baeb-4994-a290-9dd0a62bd431 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully created port: 9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:18 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully created port: bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-baa25161-34cc-4878-a6dd-45c4c921d337. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG nova.network.neutron [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63fb17d2-a3f3-45dd-b52a-ea071c5a2368 req-84c8e686-90b6-412e-9559-bd67c05f92b9 service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-changed-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Refreshing instance network info cache due to event network-changed-9c8b67f2-a61a-4580-85c9-ee3583275dc7. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Refreshing network info cache for port 9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:21 user nova-compute[75438]: INFO nova.compute.manager [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Rescuing
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-e6139ab9-94c7-453f-94c5-7aff1ab71e36. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: 73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updated VIF entry in instance network info cache for port 9c8b67f2-a61a-4580-85c9-ee3583275dc7. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-57c647be-c570-4a9d-ab7a-500ac00ebdc6 req-5954ee16-01dd-49bd-b14a-740615f6d950 service nova] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-d2aeb576-f698-4162-8c21-516f32d7b87e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: 7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c4fcbc87-b3ee-4ca9-b84c-0433cf2ef82b req-0be8daf2-d966-4bbc-9aec-9645972cd5fa service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-f9693779-a407-4863-a668-ffe5a8fabc3d req-3c68137f-8069-4f25-965a-26f21f3d1fb9 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-unplugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f9693779-a407-4863-a668-ffe5a8fabc3d req-3c68137f-8069-4f25-965a-26f21f3d1fb9 service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f9693779-a407-4863-a668-ffe5a8fabc3d req-3c68137f-8069-4f25-965a-26f21f3d1fb9 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f9693779-a407-4863-a668-ffe5a8fabc3d req-3c68137f-8069-4f25-965a-26f21f3d1fb9 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-f9693779-a407-4863-a668-ffe5a8fabc3d req-3c68137f-8069-4f25-965a-26f21f3d1fb9 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-unplugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:04:23 user nova-compute[75438]: WARNING nova.compute.manager [req-f9693779-a407-4863-a668-ffe5a8fabc3d req-3c68137f-8069-4f25-965a-26f21f3d1fb9 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-unplugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state active and task_state rescuing.
Nov 09 02:04:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance destroyed successfully.
Nov 09 02:04:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Attempting rescue
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75438) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:04:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Creating image(s)
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.542s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: 9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue" returned: 0 in 0.061s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:04:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7142MB free_disk=25.29790496826172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.614s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'migration_context' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lazy-loading 'flavor' on Instance uuid 1ba28925-aff6-48f5-a4c9-8498efc7c809 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Start _get_guest_xml network_info=[{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:53:cf:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'resources' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:04:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:04:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:04:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 1ba28925-aff6-48f5-a4c9-8498efc7c809 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ad38be13-18b6-4de6-b28a-fa027946d63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296716460',display_name='tempest-ServerRescueNegativeTestJSON-server-296716460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296716460',id=4,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-i6k9lj2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:45Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:53:cf:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:53:cf:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:04:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:04:23 user nova-compute[75438]:   <uuid>6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88</uuid>
Nov 09 02:04:23 user nova-compute[75438]:   <name>instance-00000004</name>
Nov 09 02:04:23 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:04:23 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:04:23 user nova-compute[75438]:   <metadata>
Nov 09 02:04:23 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:04:23 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:04:23 user nova-compute[75438]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-296716460</nova:name>
Nov 09 02:04:23 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:04:23</nova:creationTime>
Nov 09 02:04:23 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:04:23 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:04:23 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:04:23 user nova-compute[75438]:       <nova:owner>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:user uuid="ab1818da0f7a44fe8ae3f9ffce360386">tempest-ServerRescueNegativeTestJSON-655487496-project-member</nova:user>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:project uuid="92bdfa4af42b4c9796dd143f0c4c3da1">tempest-ServerRescueNegativeTestJSON-655487496</nova:project>
Nov 09 02:04:23 user nova-compute[75438]:       </nova:owner>
Nov 09 02:04:23 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:04:23 user nova-compute[75438]:       <nova:ports>
Nov 09 02:04:23 user nova-compute[75438]:         <nova:port uuid="d1d3d251-36fe-4955-8d02-26d0d818069f">
Nov 09 02:04:23 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:04:23 user nova-compute[75438]:         </nova:port>
Nov 09 02:04:23 user nova-compute[75438]:       </nova:ports>
Nov 09 02:04:23 user nova-compute[75438]:     </nova:instance>
Nov 09 02:04:23 user nova-compute[75438]:   </metadata>
Nov 09 02:04:23 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:04:23 user nova-compute[75438]:     <system>
Nov 09 02:04:23 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:04:23 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:04:23 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:04:23 user nova-compute[75438]:       <entry name="serial">6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88</entry>
Nov 09 02:04:23 user nova-compute[75438]:       <entry name="uuid">6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88</entry>
Nov 09 02:04:23 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:04:23 user nova-compute[75438]:     </system>
Nov 09 02:04:23 user nova-compute[75438]:   </sysinfo>
Nov 09 02:04:23 user nova-compute[75438]:   <os>
Nov 09 02:04:23 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:04:23 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:04:23 user nova-compute[75438]:   </os>
Nov 09 02:04:23 user nova-compute[75438]:   <features>
Nov 09 02:04:23 user nova-compute[75438]:     <acpi/>
Nov 09 02:04:23 user nova-compute[75438]:     <apic/>
Nov 09 02:04:23 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:04:23 user nova-compute[75438]:   </features>
Nov 09 02:04:23 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:04:23 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:04:23 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:04:23 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:04:23 user nova-compute[75438]:   </clock>
Nov 09 02:04:23 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:04:23 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:04:23 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:04:23 user nova-compute[75438]:   </cpu>
Nov 09 02:04:23 user nova-compute[75438]:   <devices>
Nov 09 02:04:23 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:04:23 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:04:23 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue"/>
Nov 09 02:04:23 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:04:23 user nova-compute[75438]:     </disk>
Nov 09 02:04:23 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:04:23 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:04:23 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk"/>
Nov 09 02:04:23 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:04:23 user nova-compute[75438]:     </disk>
Nov 09 02:04:23 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:04:23 user nova-compute[75438]:       <mac address="fa:16:3e:53:cf:94"/>
Nov 09 02:04:23 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:04:23 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:04:23 user nova-compute[75438]:       <target dev="tapd1d3d251-36"/>
Nov 09 02:04:23 user nova-compute[75438]:     </interface>
Nov 09 02:04:23 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:04:23 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/console.log" append="off"/>
Nov 09 02:04:23 user nova-compute[75438]:     </serial>
Nov 09 02:04:23 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:04:23 user nova-compute[75438]:     <video>
Nov 09 02:04:23 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:04:23 user nova-compute[75438]:     </video>
Nov 09 02:04:23 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:04:23 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:04:23 user nova-compute[75438]:     </rng>
Nov 09 02:04:23 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:04:23 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:04:23 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:04:23 user nova-compute[75438]:     </memballoon>
Nov 09 02:04:23 user nova-compute[75438]:   </devices>
Nov 09 02:04:23 user nova-compute[75438]: </domain>
Nov 09 02:04:23 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:04:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance destroyed successfully.
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:24 user nova-compute[75438]: INFO nova.compute.manager [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Attaching volume 1e778722-2bb8-466d-9aee-18496d23b137 to /dev/vdb
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:53:cf:94, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-73090444-eef2-45eb-adf7-9b5d92ec510b. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port 73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG os_brick.utils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0757fb56-2542-4199-b614-1c8761f09b28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c92461-136e-41e9-bafd-df4d7cb91908]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ae2677-3197-4009-92d2-2020362edba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f6b4ae-97ec-46dc-a070-c12274ef691d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:04:24 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ef376b-1354-4468-8c60-9b6653ea6877]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG os_brick.utils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updating existing volume attachment record: c1c03c03-2e9c-4751-91ce-4aa3717cd28b {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port 7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Successfully updated port: bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a520be5-9aba-4838-99ca-60d42e42e903 req-a4404f5e-f334-4900-b8e2-108094034462 service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:04:25 user nova-compute[75438]: WARNING nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state active and task_state rescuing.
Nov 09 02:04:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-9f479e5a-1ae3-432b-9d14-a51ea1e13e42. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:04:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:04:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance network_info: |[{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port 9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:04:27 user nova-compute[75438]: WARNING nova.compute.manager [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state active and task_state rescuing.
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:04:27 user nova-compute[75438]: WARNING nova.compute.manager [req-5d7667ce-adfa-45db-8129-846c5c50e6f6 req-cfaabe7e-422d-4fc8-9873-872189619c2f service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state active and task_state rescuing.
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updated VIF entry in instance network info cache for port 9f479e5a-1ae3-432b-9d14-a51ea1e13e42. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4195bced-5f57-450b-8b6b-5e772ca886a0 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:04:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updated VIF entry in instance network info cache for port bae05ee5-b5b1-4fa9-aabf-c57fbc020d01. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75283555-59c2-4b8b-a2d0-84c8cfe22433 req-349b9027-b2a1-426b-9e40-c5d1be10e7dd service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-changed-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Refreshing instance network info cache due to event network-changed-71877205-b0ab-456f-a4e1-9e5f638fb7fc. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Refreshing network info cache for port 71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updated VIF entry in instance network info cache for port 71877205-b0ab-456f-a4e1-9e5f638fb7fc. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-46094627-9c3a-477b-9f30-ce28a3cfebeb req-517395b7-d892-42f8-8fac-d11b912d91a1 service nova] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "59435d59-9004-4df4-adb7-e88577aa257e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:04:35 user nova-compute[75438]: INFO nova.compute.claims [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Claim successful on node user
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:04:35 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:04:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:04:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:04:36 user nova-compute[75438]: INFO nova.virt.block_device [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Booting with volume 9d2c9c45-5469-4d50-8f4a-e44f38905059 at /dev/vda
Nov 09 02:04:36 user nova-compute[75438]: DEBUG nova.policy [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4375bc91047e4cdd8e47ce6d293ce3ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8aef490395493a88d8812a79b6f079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG os_brick.utils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[293aa756-35d0-4ee5-a6f3-1bf81fbe91cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0281f30-2788-4d82-ba90-ff546b0f349c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9c9352-699d-4259-8c4f-e0970cef7568]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6184a19-8ab4-4868-bfb4-0248426cb906]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:04:36 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:04:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a52872-a751-461b-9dae-617c970623dc]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG os_brick.utils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating existing volume attachment record: 7f32bbe9-93e3-47a9-bb28-21a2c7a7e099 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:04:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully created port: ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully created port: 5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully created port: 86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully created port: 59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully created port: b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-ad8c5704-eb79-468a-98ce-afa53f7a2b90. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cf4bbc18-f4f9-4a4f-b00f-9b547fa152e0 req-ec165fc2-969e-4a47-a1e2-edae3380ea96 service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:40 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: 2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-2907c1c0-6a46-4f04-8511-569ba9ba63a7. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG nova.network.neutron [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port 2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: 5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:41 user nova-compute[75438]: DEBUG nova.network.neutron [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.network.neutron [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-d88f402e-ff60-4542-9d92-683833d89cb9. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.network.neutron [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.network.neutron [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.network.neutron [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-171434ee-898c-4dfe-abf0-0b25a8b3df62 req-19516a7c-b827-4e80-9247-d89267264c6a service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: 86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: 59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Successfully updated port: b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-5b43caae-cb58-41b0-b9ab-169f1ffd5299. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:45 user nova-compute[75438]: DEBUG nova.network.neutron [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance network_info: |[{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:04:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:45 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port 5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updated VIF entry in instance network info cache for port 5b43caae-cb58-41b0-b9ab-169f1ffd5299. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-86e311b5-32c1-41b5-98a8-4aaaac57e470. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port 86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updated VIF entry in instance network info cache for port 86e311b5-32c1-41b5-98a8-4aaaac57e470. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-59faaff1-46be-4ca5-b04f-1ba05fd992fc. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port 59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updated VIF entry in instance network info cache for port 59faaff1-46be-4ca5-b04f-1ba05fd992fc. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-b8b1235a-e337-42a8-8f96-46c00cd1422c. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updated VIF entry in instance network info cache for port b8b1235a-e337-42a8-8f96-46c00cd1422c. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-357e0177-3d19-4a17-9e29-7fd26890c5b4 req-dcdc000b-f0d2-4f8e-980f-87ce34dcf1ac service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-changed-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Refreshing instance network info cache due to event network-changed-edbd4134-fb45-4bf8-9b11-b1a854c81151. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] Acquiring lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] Acquired lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:48 user nova-compute[75438]: DEBUG nova.network.neutron [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Refreshing network info cache for port edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updated VIF entry in instance network info cache for port edbd4134-fb45-4bf8-9b11-b1a854c81151. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updating instance_info_cache with network_info: [{"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8315b93c-5385-4d42-9c5f-d1d0cea5f33b req-94476557-e7b4-485f-8e42-f95eb06d8d56 service nova] Releasing lock "refresh_cache-5148fd3c-cf19-4108-bcf2-7ef96368cbc5" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-changed-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Refreshing instance network info cache due to event network-changed-72486962-8dbd-4bd1-99d3-14bf7a29caa3. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] Acquiring lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] Acquired lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:56 user nova-compute[75438]: DEBUG nova.network.neutron [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Refreshing network info cache for port 72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:57 user nova-compute[75438]: DEBUG nova.network.neutron [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updated VIF entry in instance network info cache for port 72486962-8dbd-4bd1-99d3-14bf7a29caa3. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:57 user nova-compute[75438]: DEBUG nova.network.neutron [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating instance_info_cache with network_info: [{"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9aa78012-f675-48cb-a980-5f952b26027f req-d1b03d54-319c-468d-999f-8ba4be3b709d service nova] Releasing lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-changed-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Refreshing instance network info cache due to event network-changed-c29727fb-924a-4912-a60e-c6af7386834e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] Acquiring lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] Acquired lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Refreshing network info cache for port c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "interface-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "interface-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.objects.instance [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'flavor' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.objects.instance [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'pci_requests' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updated VIF entry in instance network info cache for port c29727fb-924a-4912-a60e-c6af7386834e. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.objects.base [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Object Instance<0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac> lazy-loaded attributes: flavor,pci_requests {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6b77f926-0ae6-4f47-8c38-de4b2076eeb5 req-fd54abfa-fc2b-46c6-a0fe-3d5bc1be56bb service nova] Releasing lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:04:59 user nova-compute[75438]: DEBUG nova.policy [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '465ad518561a4635835ffe05296b0d6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c16810f93a475abcee4b697a8019bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG nova.objects.instance [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lazy-loading 'flavor' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:00 user nova-compute[75438]: INFO nova.virt.block_device [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Booting with volume 7838b1b5-648a-460b-bdb2-88c8f09553bd at /dev/vdb
Nov 09 02:05:00 user nova-compute[75438]: DEBUG nova.network.neutron [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Successfully created port: 350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:00 user nova-compute[75438]: INFO nova.compute.manager [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Attaching volume ea000b0d-4862-4303-8e98-5e99b87a7bc2 to /dev/vdb
Nov 09 02:05:00 user nova-compute[75438]: DEBUG os_brick.utils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dfc33c-4a74-4b1e-9e3e-f5a3bd990857]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[408923d3-6a25-40ea-94b8-50863e7beab5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3ddb7-8053-4ef0-8674-5d427d76259d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[db566cf8-99f1-4fd5-82d4-88730f3d6b3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:00 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de22816-7f9c-4f18-a522-4aa63ef58517]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG os_brick.utils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating existing volume attachment record: 92a3ade5-73c6-4256-a941-67171abd6664 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:00 user nova-compute[75438]: INFO nova.compute.manager [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Attaching volume f85746e7-c2e7-4e22-84a9-09c692f13714 to /dev/vdb
Nov 09 02:05:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Successfully updated port: 350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:05:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:05:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquired lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:05:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:05:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-changed-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Refreshing instance network info cache due to event network-changed-350cbba2-4bc6-4b04-9d14-ad385469f945. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:05:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] Acquiring lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-changed-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Refreshing instance network info cache due to event network-changed-608d3a29-ea2e-4f08-9a14-334873c6f6d6. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] Acquiring lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] Acquired lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Refreshing network info cache for port 608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Releasing lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] Acquired lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Refreshing network info cache for port 350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG os_vif [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fcb99da-1e12-59c0-beae-a145eff3fe2d', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350cbba2-4b, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap350cbba2-4b, col_values=(('qos', UUID('1d8b6852-5809-41da-a4f0-cba9c3345c38')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap350cbba2-4b, col_values=(('external_ids', {'iface-id': '350cbba2-4bc6-4b04-9d14-ad385469f945', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ef:90', 'vm-uuid': '0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: INFO os_vif [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b')
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] attach device xml: <interface type="ethernet">
Nov 09 02:05:02 user nova-compute[75438]:   <mac address="fa:16:3e:7a:ef:90"/>
Nov 09 02:05:02 user nova-compute[75438]:   <model type="virtio"/>
Nov 09 02:05:02 user nova-compute[75438]:   <mtu size="1442"/>
Nov 09 02:05:02 user nova-compute[75438]:   <target dev="tap350cbba2-4b"/>
Nov 09 02:05:02 user nova-compute[75438]: </interface>
Nov 09 02:05:02 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updated VIF entry in instance network info cache for port 608d3a29-ea2e-4f08-9a14-334873c6f6d6. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updating instance_info_cache with network_info: [{"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-80b68618-bfd5-40f0-9ccb-854e15071b99 req-b91d4b4b-e2a1-4ee5-bbd1-908b8f3a3a75 service nova] Releasing lock "refresh_cache-02ef8bf0-077e-4653-98f5-9e6fef690fdb" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No BDM found with device name hda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No VIF found with MAC fa:16:3e:b4:98:b3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:05:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:05:02 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:05:02 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:05:02 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:05:02</nova:creationTime>
Nov 09 02:05:02 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:05:02 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:05:02 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:05:02 user nova-compute[75438]:   <nova:owner>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:05:02 user nova-compute[75438]:   </nova:owner>
Nov 09 02:05:02 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:05:02 user nova-compute[75438]:   <nova:ports>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:05:02 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:05:02 user nova-compute[75438]:     </nova:port>
Nov 09 02:05:02 user nova-compute[75438]:     <nova:port uuid="350cbba2-4bc6-4b04-9d14-ad385469f945">
Nov 09 02:05:02 user nova-compute[75438]:       <nova:ip type="fixed" address="10.10.10.173" ipVersion="4"/>
Nov 09 02:05:02 user nova-compute[75438]:     </nova:port>
Nov 09 02:05:02 user nova-compute[75438]:   </nova:ports>
Nov 09 02:05:02 user nova-compute[75438]: </nova:instance>
Nov 09 02:05:02 user nova-compute[75438]:  {{(pid=75438) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG nova.network.neutron [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updated VIF entry in instance network info cache for port 350cbba2-4bc6-4b04-9d14-ad385469f945. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG nova.network.neutron [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-75f2ae8e-c28a-43d0-b78e-56a3eccf2949 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "interface-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.348s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6cd7d891-551e-41a7-b41b-f3ba76e3e2b4 req-8382325f-2b07-4523-b969-44bc26f3d87a service nova] Releasing lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:05:04 user nova-compute[75438]: WARNING nova.compute.manager [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 for instance with vm_state active and task_state None.
Nov 09 02:05:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:05:04 user nova-compute[75438]: WARNING nova.compute.manager [req-63dcb0c5-9a4a-4167-b9b4-81b3615bdfa9 req-1a0b6e4f-1475-4c09-9f5f-ea17863a2780 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 for instance with vm_state active and task_state None.
Nov 09 02:05:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.utils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connector [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Factory for ISCSI on None {{(pid=75438) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btkJgvpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:11 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:11 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:11 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2676f3f1-aa49-4fae-a7b1-3b2266d01b16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166a252-ade9-46bb-9d70-2902ebc05949]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:05:11 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6f7f4-4670-4bce-b87c-cc1d3a976225]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7571c90-4c61-4353-a808-26f7a3a1deac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137] added
Nov 09 02:05:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20083c08-c02d-4f7c-be8a-6ff0c89f1844]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd54f3e4-83e1-4132-9972-23bfedbb1f23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1713a441-fa37-4b5b-bb3a-2827fea12a10]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4a62ba-67a2-4b58-b268-b6b875a5721a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:11 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c92e6c5-9b5e-4ba8-9a96-0daed1bb9507]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btkJgvpx {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.utils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating existing volume attachment record: e833e7ec-dca8-4308-ac13-b5cffd56cb2c {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btkJgvpx" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db9375-03dc-4e4e-9e46-76cab96abae1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btkJgvpx'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca8893d-1507-49ed-8d8c-6140d856e978]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lazy-loading 'flavor' on Instance uuid 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9cd056-1f42-4ee4-8a7f-d80038b1c726]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:05:11 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:05:11 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:11 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:05:11 user nova-compute[75438]: 
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'flavor' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.utils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9fefef-6a47-4111-aa41-1561b4d27c73]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f224e6-f10f-4cd8-9742-021fed89aafc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260]
Nov 09 02:05:11 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260] successful.
Nov 09 02:05:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ddb1d-c9b5-41ab-9ee0-bafb69c3ebce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: INFO nova.virt.block_device [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Booting with volume ce80beed-d13a-4405-83df-f450d331b989 at /dev/vdb
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23aa85-3ec9-443d-9d87-8c07ee482649]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4627a7bf-d3d8-487c-bae8-4bb477ee6482]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc908c4-260c-4c21-829d-7e5b3f40da01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ed7d1-cfee-4fe6-8ec2-5f79341914ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:11 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafed0d3-35a0-44db-a2ce-74b08af1b510]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.utils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating existing volume attachment record: 1332f2ed-7606-4ad7-9f46-0f0475707c5e {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8123cc97-e388-4aaf-953a-08132aa27918]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btkJgvpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lazy-loading 'flavor' on Instance uuid 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:11 user nova-compute[75438]: INFO nova.compute.manager [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Attaching volume 55eb550d-ba8f-4307-8994-92430fccef61 to /dev/vdb
Nov 09 02:05:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:12 user nova-compute[75438]: INFO nova.compute.manager [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Attaching volume b0d1c960-fa39-414a-82da-8d2d2a559c5f to /dev/vdb
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.utils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c840a0a-aa96-435f-9bac-42a773f152c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[665911e3-e646-4366-9a39-08c2b731031c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[70030964-ce13-4969-9e92-6729b3bad2b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3413004-2418-4d93-9068-120dd3187c03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:12 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75956ea-f2fe-4d40-86c5-5064ecaf36a8]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.utils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating existing volume attachment record: 01cb8213-b7f8-4611-9830-99d244b7d916 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26666393036616431', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666393036616431', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lazy-loading 'flavor' on Instance uuid 1ba28925-aff6-48f5-a4c9-8498efc7c809 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:05:12 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:05:12 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:05:12 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:05:12 user nova-compute[75438]:   <serial>1e778722-2bb8-466d-9aee-18496d23b137</serial>
Nov 09 02:05:12 user nova-compute[75438]: </disk>
Nov 09 02:05:12 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:05:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] No VIF found with MAC fa:16:3e:6a:85:0b, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:05:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:18 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:05:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7407MB free_disk=25.284358978271484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 1ba28925-aff6-48f5-a4c9-8498efc7c809 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ad38be13-18b6-4de6-b28a-fa027946d63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 59435d59-9004-4df4-adb7-e88577aa257e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:05:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:05:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:05:24 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:05:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:05:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:05:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:05:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:05:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:05:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:05:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:05:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:36 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:36 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:36 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f96b756-80c9-4f22-ba56-9918306e8d17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:05:36 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[680b0a62-c22b-49d5-9fd4-94c0f6508aa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714] added
Nov 09 02:05:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[505cf49b-4868-4b85-9f4f-bf60d92d7906]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a4b64-bee9-48de-af42-fa2e0c31c6f2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXscDUJB {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXscDUJB" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be06221-8126-4f32-b3f3-cdb5bfa4648f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXscDUJB'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3179f77-d92e-4000-a4e7-0da52aac0571]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8fbb92-a19d-4274-aa8d-3f42f5cf1613]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b03b83-c493-4fcc-a4d3-0e3be596990d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]
Nov 09 02:05:37 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.
Nov 09 02:05:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbaaa88-bd44-4e57-b65a-909278dda20f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364803f-7f67-4763-8623-289054a4f6c9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:37 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:37 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c539e1-52f9-4a69-855c-d2352af0c6d3]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3f9d76b9-2efb-416f-af1f-7fab9a3cf0a8 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 73.373s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:37 user nova-compute[75438]: INFO nova.virt.block_device [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Booting with volume 1ddacd56-1b95-4f96-9077-a7b613f19679 at /dev/vdc
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.utils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb7f7b-236e-426d-9aeb-4ccf9ea00996]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5772c-9282-463e-9ff3-01b57a3eadff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16744c-91f6-4adf-9cf3-e700ef0cb65e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c9bc1b-2efa-4a02-b4f2-97dc3d3f9310]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:37 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b501c1a-a0b6-4461-b10f-e9127984d20e]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.utils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating existing volume attachment record: 92e87dee-0dae-4c8d-a221-363b4befabd8 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.utils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[681526db-1d36-47d9-8421-2447d2c22a1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:37 user nova-compute[75438]: INFO nova.compute.manager [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Attaching volume 826b6b7b-447d-4787-9c34-fbafad5fc653 to /dev/sdc
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8dff8-487b-446e-9dc2-108ddfb500c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91ce9ab-f3a4-4616-ae2f-b565ffb7983c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe6d128-63ad-4729-81b8-f33ef494f649]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:37 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac6ab44-df0d-4f9b-b2c5-107c01a58abf]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG os_brick.utils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:37 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updating existing volume attachment record: 732e68fd-d08c-4cc9-a121-603cf2c792e1 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26564376533376232', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564376533376232', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG nova.objects.instance [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lazy-loading 'flavor' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:05:38 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:05:38 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:05:38 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:05:38 user nova-compute[75438]:   <serial>f85746e7-c2e7-4e22-84a9-09c692f13714</serial>
Nov 09 02:05:38 user nova-compute[75438]: </disk>
Nov 09 02:05:38 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] No VIF found with MAC fa:16:3e:86:01:22, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:05:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:05:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:05:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:05:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:05:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:05:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:05:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:05:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:05:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:48 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb2c9e-72e7-4c85-a85f-00cc80d2227b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:05:48 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964ce01-8061-4235-9b03-9ef9f0e5dace]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2] added
Nov 09 02:05:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525b9e5-7c8c-47e9-9598-9b9734b81803]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da1dd40-aeac-41d1-aa00-e4a9ebff66f7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQhSrqmJ {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQhSrqmJ" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb57f323-d987-48b0-9094-16bdfb319f1f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQhSrqmJ'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9330445-6d30-4995-8276-fb188d473088]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d33019a-6893-47b8-bc86-c238e63d9bc7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02db9d-ef8f-436f-bdcb-e1777109c5f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]
Nov 09 02:05:48 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.
Nov 09 02:05:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e19d291-8f70-405b-9782-f1efdc948f5e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:48 user nova-compute[75438]: INFO nova.compute.manager [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Terminating instance
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbc48b-2652-42f4-a8b8-e710228a5b84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:05:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2b04fa-44ce-4884-9a88-ec7c972f16cd]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-4fd4e856-cc32-4fed-aad4-920585ba8cdf req-dfa83026-b1d8-41fe-8ed5-f7f4eada06a1 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-vif-unplugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4fd4e856-cc32-4fed-aad4-920585ba8cdf req-dfa83026-b1d8-41fe-8ed5-f7f4eada06a1 service nova] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4fd4e856-cc32-4fed-aad4-920585ba8cdf req-dfa83026-b1d8-41fe-8ed5-f7f4eada06a1 service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4fd4e856-cc32-4fed-aad4-920585ba8cdf req-dfa83026-b1d8-41fe-8ed5-f7f4eada06a1 service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-4fd4e856-cc32-4fed-aad4-920585ba8cdf req-dfa83026-b1d8-41fe-8ed5-f7f4eada06a1 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] No waiting events found dispatching network-vif-unplugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-4fd4e856-cc32-4fed-aad4-920585ba8cdf req-dfa83026-b1d8-41fe-8ed5-f7f4eada06a1 service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-vif-unplugged-e451a393-86bc-428f-9f3b-cb5d9541507e for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:05:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Instance destroyed successfully.
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lazy-loading 'resources' on Instance uuid 1ba28925-aff6-48f5-a4c9-8498efc7c809 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1032747937',display_name='tempest-DeleteServersTestJSON-server-1032747937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1032747937',id=1,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f222b77aad794a479937ad3ce632421a',ramdisk_id='',reservation_id='r-yckul1ca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-653233604',owner_user_name='tempest-DeleteServersTestJSON-653233604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:02:42Z,user_data=None,user_id='aabdffb27b96446997cf07a179f19636',uuid=1ba28925-aff6-48f5-a4c9-8498efc7c809,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Converting VIF {"id": "e451a393-86bc-428f-9f3b-cb5d9541507e", "address": "fa:16:3e:6a:85:0b", "network": {"id": "419f18db-52c4-48b9-bbc0-f480698fec3a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-90793798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f222b77aad794a479937ad3ce632421a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape451a393-86", "ovs_interfaceid": "e451a393-86bc-428f-9f3b-cb5d9541507e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_vif [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape451a393-86, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba2a114f-3785-4940-b5f8-7eb120e956f3) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:49 user nova-compute[75438]: INFO os_vif [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:85:0b,bridge_name='br-int',has_traffic_filtering=True,id=e451a393-86bc-428f-9f3b-cb5d9541507e,network=Network(419f18db-52c4-48b9-bbc0-f480698fec3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape451a393-86')
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btkJgvpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:49 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23864353936623637', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864353936623637', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.238s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a9448b-624e-44cc-abe3-a2d1e1dbe9dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:05:49 user nova-compute[75438]: No targets found.
Nov 09 02:05:49 user nova-compute[75438]: iSNS:
Nov 09 02:05:49 user nova-compute[75438]: No targets found.
Nov 09 02:05:49 user nova-compute[75438]: STATIC:
Nov 09 02:05:49 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137
Nov 09 02:05:49 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:05:49 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:05:49 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:05:49 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:05:49 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:05:49 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:05:49 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:05:49 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:05:49 user nova-compute[75438]: FIRMWARE:
Nov 09 02:05:49 user nova-compute[75438]: No targets found.
Nov 09 02:05:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:05:49 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:05:49 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:05:49 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:05:49 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:05:49 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:05:49 user nova-compute[75438]:   <serial>ea000b0d-4862-4303-8e98-5e99b87a7bc2</serial>
Nov 09 02:05:49 user nova-compute[75438]: </disk>
Nov 09 02:05:49 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a1e0fd-8e32-4eeb-9657-4a5485ca5af5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ee2ea-2281-4f89-8cbb-6b044d677b26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:49 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:49 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:05:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 (non-flash)
Nov 09 02:05:49 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:05:49 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:05:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245ba170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8896524-905c-460e-b010-6e8eb0672584]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea815b3d-50ed-48e3-a5ad-a12839c213c2]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa57a788-c204-41e5-8e10-53e1fb5b476b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2a852a-1b35-438e-af92-1195b47f208d]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd1e3f-57fa-4170-aba3-8ad564fa1e1b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d739dd-7280-46f3-8841-55b589c20c97]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260]
Nov 09 02:05:49 user nova-compute[75438]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137, portal: 172.16.0.220,3260] successful.
Nov 09 02:05:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e778722-2bb8-466d-9aee-18496d23b137 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89c4041-f2d9-466a-95b8-2a690433322a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] <== disconnect_volume: return (547ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:05:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Deleting instance files /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809_del
Nov 09 02:05:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Deletion of /opt/stack/data/nova/instances/1ba28925-aff6-48f5-a4c9-8498efc7c809_del complete
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75438) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 09 02:05:49 user nova-compute[75438]: INFO nova.virt.libvirt.host [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] UEFI support detected
Nov 09 02:05:49 user nova-compute[75438]: INFO nova.compute.manager [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 09 02:05:49 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:05:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No VIF found with MAC fa:16:3e:81:73:9c, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:05:50 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:05:50 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Took 0.52 seconds to deallocate network for instance.
Nov 09 02:05:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] Acquiring lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] No waiting events found dispatching network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:05:50 user nova-compute[75438]: WARNING nova.compute.manager [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received unexpected event network-vif-plugged-e451a393-86bc-428f-9f3b-cb5d9541507e for instance with vm_state active and task_state deleting.
Nov 09 02:05:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-30e33f14-bd78-4684-a815-911f671876f1 req-df38b2e4-6787-48ea-a476-9f0072be9d7c service nova] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Received event network-vif-deleted-e451a393-86bc-428f-9f3b-cb5d9541507e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.utils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[63020e9f-c8b8-404a-a3af-e16ce57bd30c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a6eec-cd96-49b7-a475-1fc85e231d57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55ecf3-58bf-41bb-9877-9c5bd0220810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3de2a50-dc96-4a77-bbed-7ebf69cd602d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:52 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc461944-2704-4613-9580-7c0430547dcf]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.utils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating existing volume attachment record: 90d87968-b9a4-42d0-a184-efdf27efebb7 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-94b53dfa-8136-4af3-8c36-093acae794fa tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.568s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.utils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c15bb2-cc22-4a51-81da-c4ed58426e0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e358c9-d1d5-49d6-bfd2-9102066d3cab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd84017-43de-49c8-a854-b61b4f0ccfe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6838659-e9d2-4115-8556-a8d8c20a1732]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a9de049d-3a6f-4f6a-ab55-a8235bf81fe9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.984s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:05:52 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:05:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8443a0e2-bc4b-4087-ac56-49a51def3152]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG os_brick.utils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:05:52 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updating existing volume attachment record: 2dcefebb-7a54-4dd2-8861-e58a74c26954 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:05:53 user nova-compute[75438]: INFO nova.compute.manager [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] [instance: 1ba28925-aff6-48f5-a4c9-8498efc7c809] Took 3.37 seconds to detach 1 volumes for instance.
Nov 09 02:05:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:05:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:05:53 user nova-compute[75438]: INFO nova.virt.block_device [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Booting with volume 8ee8bf43-ffec-4594-8286-830dea8c3a0b at /dev/vdc
Nov 09 02:05:54 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:05:54 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:05:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:05:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:54 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Deleted allocations for instance 1ba28925-aff6-48f5-a4c9-8498efc7c809
Nov 09 02:05:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bdad25f8-5cf7-4f50-be96-385b3669aa72 tempest-DeleteServersTestJSON-653233604 tempest-DeleteServersTestJSON-653233604-project-member] Lock "1ba28925-aff6-48f5-a4c9-8498efc7c809" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.058s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:05:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoYnsABw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:04 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:04 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:04 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddce62f8-3275-43f9-abe4-2de98c303f1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:06:04 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52f57c4-f8b8-4f44-b72c-1c0d98280d15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61] added
Nov 09 02:06:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f6dcfa-0293-4642-8659-11d2aad42a3c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6633ded1-08ec-4712-b02d-4d5c2d1a8f88]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qoYnsABw {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qoYnsABw" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60bc0f3-294c-41cc-a4d4-f172f781c0ae]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qoYnsABw'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[917eccd8-b34f-448d-b72b-48f3de9641b4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[acace147-fc4e-4dfb-bb7d-98c8bb9c524d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7cce8-3801-4764-821c-97bed159a435]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260]
Nov 09 02:06:04 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc490a6-54d5-4539-9ba7-32e65bb5bac5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f48fd70-da61-4ec4-8fe1-0d6fa35ec399]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] HCTL ('33', '-', '-', 0) found on session 5 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffdedbe-b5c6-49fa-b45a-f6d24df79367]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Searching for a device in session 5 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoYnsABw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26231623866666461', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231623866666461', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'flavor' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:06:05 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:05 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:06:05 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:06:05 user nova-compute[75438]:   <serial>55eb550d-ba8f-4307-8994-92430fccef61</serial>
Nov 09 02:06:05 user nova-compute[75438]: </disk>
Nov 09 02:06:05 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No BDM found with device name hda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] No VIF found with MAC fa:16:3e:b4:98:b3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:06:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSZvcQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:14 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:14 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:14 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2004e29-9deb-4958-9d3d-bfcbc04cb797]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:06:14 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c9e97d-3129-4df8-80e8-cfd1972c2984]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f] added
Nov 09 02:06:14 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a2c7eb-0f78-4fca-8b0d-615b7d1eaf42]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e427a4-5690-467c-a784-ba0b8f6919ed]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkSZvcQA {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkSZvcQA" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e024f13-7cbf-4ffe-9a61-d455459647b5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkSZvcQA'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b587f3eb-23d9-4006-bf76-b26c8a471364]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[457a9d8a-6798-4337-bac9-6692a3a0b537]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e1022-accb-4bef-98d7-b850993c796b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260]
Nov 09 02:06:14 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:14 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f929c2-7c44-47d4-9728-4745d82b6b6e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3319b575-bde2-4a27-9113-65d5b1af2d8c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:14 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:14 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:14 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bbd281-bbc4-4d0c-bcd6-dfc5aaaac7e6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSZvcQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:06:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bd7797ea-5ea0-4b6a-9ad8-20732133f20a tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 62.985s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.utils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[83897c86-72c5-440d-96f2-e43843354fe0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fceb88-81d5-493c-931b-8fda82759ec1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bbf825-5362-415c-9764-0e128fc0895b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f53f015-631c-48af-b9ea-c2b7d7c5f1f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75438) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.objects.instance [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:06:15 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:06:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5b5d01-19dd-4166-a4c6-2252b1b467f4]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.utils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating existing volume attachment record: cc5c4e05-d22a-4cad-8f7a-4f597acb97dc {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23566626664346165', 'path': '/dev/sde'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566626664346165', 'path': '/dev/sde'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.objects.instance [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lazy-loading 'flavor' on Instance uuid 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] attach device xml: <disk type="block" device="disk">
Nov 09 02:06:15 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:15 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:06:15 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:06:15 user nova-compute[75438]:   <serial>b0d1c960-fa39-414a-82da-8d2d2a559c5f</serial>
Nov 09 02:06:15 user nova-compute[75438]: </disk>
Nov 09 02:06:15 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-edc39cad-b2ed-4441-a9a5-265f2a812dd5 req-89002ae3-c010-4bf1-a96a-9ab91b031054 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-edc39cad-b2ed-4441-a9a5-265f2a812dd5 req-89002ae3-c010-4bf1-a96a-9ab91b031054 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-edc39cad-b2ed-4441-a9a5-265f2a812dd5 req-89002ae3-c010-4bf1-a96a-9ab91b031054 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-edc39cad-b2ed-4441-a9a5-265f2a812dd5 req-89002ae3-c010-4bf1-a96a-9ab91b031054 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-edc39cad-b2ed-4441-a9a5-265f2a812dd5 req-89002ae3-c010-4bf1-a96a-9ab91b031054 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:16 user nova-compute[75438]: WARNING nova.compute.manager [req-edc39cad-b2ed-4441-a9a5-265f2a812dd5 req-89002ae3-c010-4bf1-a96a-9ab91b031054 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state active and task_state powering-off.
Nov 09 02:06:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance destroyed successfully.
Nov 09 02:06:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] No VIF found with MAC fa:16:3e:9e:3d:14, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:06:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-db6ea504-7b51-4a31-8691-e1ea46b7f83b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.284s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-b9d498d3-7f1d-49eb-a7ec-2d2e8be8343d req-79e91db6-735f-402e-bd84-82ad62ce5f6e service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b9d498d3-7f1d-49eb-a7ec-2d2e8be8343d req-79e91db6-735f-402e-bd84-82ad62ce5f6e service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b9d498d3-7f1d-49eb-a7ec-2d2e8be8343d req-79e91db6-735f-402e-bd84-82ad62ce5f6e service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b9d498d3-7f1d-49eb-a7ec-2d2e8be8343d req-79e91db6-735f-402e-bd84-82ad62ce5f6e service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-b9d498d3-7f1d-49eb-a7ec-2d2e8be8343d req-79e91db6-735f-402e-bd84-82ad62ce5f6e service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:18 user nova-compute[75438]: WARNING nova.compute.manager [req-b9d498d3-7f1d-49eb-a7ec-2d2e8be8343d req-79e91db6-735f-402e-bd84-82ad62ce5f6e service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state stopped and task_state None.
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:18 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04d98abe-89d5-40c7-ba81-e9f9a19e7c59 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 68.548s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:06:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Creating image(s)
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Ensure instance console log exists: /opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Start _get_guest_xml network_info=[{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '7f32bbe9-93e3-47a9-bb28-21a2c7a7e099', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXltKAuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59435d59-9004-4df4-adb7-e88577aa257e', 'attached_at': '', 'detached_at': '', 'volume_id': '9d2c9c45-5469-4d50-8f4a-e44f38905059', 'serial': '9d2c9c45-5469-4d50-8f4a-e44f38905059'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '92a3ade5-73c6-4256-a941-67171abd6664', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAgmrPTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59435d59-9004-4df4-adb7-e88577aa257e', 'attached_at': '', 'detached_at': '', 'volume_id': '7838b1b5-648a-460b-bdb2-88c8f09553bd', 'serial': '7838b1b5-648a-460b-bdb2-88c8f09553bd'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '90d87968-b9a4-42d0-a184-efdf27efebb7', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brnLiTjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '59435d59-9004-4df4-adb7-e88577aa257e', 'attached_at': '', 'detached_at': '', 'volume_id': '1ddacd56-1b95-4f96-9077-a7b613f19679', 'serial': '1ddacd56-1b95-4f96-9077-a7b613f19679'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:06:20 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:06:20 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXltKAuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:20 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb00a83-a3bd-4c57-ae95-11838f3e1600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:06:20 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11247ffa-97c6-41ae-9fd8-1df554edbaae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059] added
Nov 09 02:06:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ccb664-8e8c-4dc1-9f91-5ebd27a50c45]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c7c24e-4699-45d6-a81e-415208a648c6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXltKAuO {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXltKAuO" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a4a12-4b5c-416d-bf28-545acec02c90]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXltKAuO'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4094ebb8-c245-44f2-a521-f8049fbe6142]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1407e572-fc36-4b17-96ae-33d9eeeeba8e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e03d9-8584-4b3d-a138-a234b8df6f97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260]
Nov 09 02:06:21 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b349ff-b48a-4e7b-9f82-3440df49549f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5962305-9274-454f-98aa-b43f373cb39c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:21 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b611a1d-e6e6-4fa3-a25e-a647310a9c84]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXltKAuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23564376666623731', 'path': '/dev/sdf'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564376666623731', 'path': '/dev/sdf'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAgmrPTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:22 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1460c2-2f72-4ec6-af10-f4479907df70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:06:22 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[55913473-9a9d-48ed-9084-0e5a2374142a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd] added
Nov 09 02:06:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9461901-745d-4f7f-ade2-78d65f00e8f8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade11699-e413-441d-bd12-7b5a4daf6dbf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HAgmrPTS {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HAgmrPTS" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6ec3ae-c025-4c3c-b44a-6f2b18de7fea]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HAgmrPTS'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fbbecb-bcef-4c40-ad6f-bedd1e560812]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[679cecea-82cd-4d9b-ad87-0586838f120d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a5530-ab69-4fce-af6f-d35560e5b9ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260]
Nov 09 02:06:22 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b12ffc-54ab-483f-a586-c082128e1fd3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7717e6f8-0c68-4514-9b0f-c15655b6017f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:22 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7a6c7b-aea3-4f21-9b6c-7a5f73b7a273]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAgmrPTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:06:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7912MB free_disk=25.31029510498047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ad38be13-18b6-4de6-b28a-fa027946d63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 59435d59-9004-4df4-adb7-e88577aa257e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23062626432663530', 'path': '/dev/sdg'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062626432663530', 'path': '/dev/sdg'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brnLiTjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:23 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:23 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:23 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521b683-1b48-4994-bdd3-d95b09d64e30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:06:23 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fd9b18-79bd-468c-9faa-032c3714696a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679] added
Nov 09 02:06:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c37790f-8161-4ca2-91e6-88dc4a82985d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f4e8a2-3438-407f-a100-7d9008115143]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brnLiTjA {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v brnLiTjA" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4df21-4379-4fde-a477-b61f23226c7e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'brnLiTjA'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde0e61-1dc7-4eea-a1d0-c11040acf30a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[03161752-d964-40fd-9874-7ca04da22f7b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:23 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:06:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaca94f-be6a-4bc4-9053-def501300814]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260]
Nov 09 02:06:24 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15915af-e305-48bf-8d49-62ca70a1c0cb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded59fe-cc0d-4de1-94b1-319d2806ea77]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:24 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d3cd26-7f0c-4315-8492-3f8bafb937b9]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brnLiTjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:24 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23964336635346439', 'path': '/dev/sdh'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964336635346439', 'path': '/dev/sdh'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lazy-loading 'pci_devices' on Instance uuid 59435d59-9004-4df4-adb7-e88577aa257e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:06:25 user nova-compute[75438]:   <uuid>59435d59-9004-4df4-adb7-e88577aa257e</uuid>
Nov 09 02:06:25 user nova-compute[75438]:   <name>instance-0000000c</name>
Nov 09 02:06:25 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:06:25 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:06:25 user nova-compute[75438]:   <metadata>
Nov 09 02:06:25 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:06:25 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:06:25 user nova-compute[75438]:       <nova:name>tempest-device-tagging-server-134654539</nova:name>
Nov 09 02:06:25 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:06:20</nova:creationTime>
Nov 09 02:06:25 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:06:25 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:06:25 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:06:25 user nova-compute[75438]:       <nova:owner>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:user uuid="4375bc91047e4cdd8e47ce6d293ce3ca">tempest-TaggedBootDevicesTest_v242-938311404-project-member</nova:user>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:project uuid="af8aef490395493a88d8812a79b6f079">tempest-TaggedBootDevicesTest_v242-938311404</nova:project>
Nov 09 02:06:25 user nova-compute[75438]:       </nova:owner>
Nov 09 02:06:25 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:06:25 user nova-compute[75438]:       <nova:ports>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="ad8c5704-eb79-468a-98ce-afa53f7a2b90">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="2907c1c0-6a46-4f04-8511-569ba9ba63a7">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.134" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="d88f402e-ff60-4542-9d92-683833d89cb9">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="5b43caae-cb58-41b0-b9ab-169f1ffd5299">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="86e311b5-32c1-41b5-98a8-4aaaac57e470">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.161" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="59faaff1-46be-4ca5-b04f-1ba05fd992fc">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:         <nova:port uuid="b8b1235a-e337-42a8-8f96-46c00cd1422c">
Nov 09 02:06:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 09 02:06:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:06:25 user nova-compute[75438]:       </nova:ports>
Nov 09 02:06:25 user nova-compute[75438]:     </nova:instance>
Nov 09 02:06:25 user nova-compute[75438]:   </metadata>
Nov 09 02:06:25 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:06:25 user nova-compute[75438]:     <system>
Nov 09 02:06:25 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:06:25 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:06:25 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:06:25 user nova-compute[75438]:       <entry name="serial">59435d59-9004-4df4-adb7-e88577aa257e</entry>
Nov 09 02:06:25 user nova-compute[75438]:       <entry name="uuid">59435d59-9004-4df4-adb7-e88577aa257e</entry>
Nov 09 02:06:25 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:06:25 user nova-compute[75438]:     </system>
Nov 09 02:06:25 user nova-compute[75438]:   </sysinfo>
Nov 09 02:06:25 user nova-compute[75438]:   <os>
Nov 09 02:06:25 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:06:25 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:06:25 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:06:25 user nova-compute[75438]:   </os>
Nov 09 02:06:25 user nova-compute[75438]:   <features>
Nov 09 02:06:25 user nova-compute[75438]:     <acpi/>
Nov 09 02:06:25 user nova-compute[75438]:     <apic/>
Nov 09 02:06:25 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:06:25 user nova-compute[75438]:   </features>
Nov 09 02:06:25 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:06:25 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:06:25 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:06:25 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:06:25 user nova-compute[75438]:   </clock>
Nov 09 02:06:25 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:06:25 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:06:25 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:06:25 user nova-compute[75438]:   </cpu>
Nov 09 02:06:25 user nova-compute[75438]:   <devices>
Nov 09 02:06:25 user nova-compute[75438]:     <disk type="file" device="cdrom">
Nov 09 02:06:25 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 02:06:25 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e/disk.config"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="hda" bus="ide"/>
Nov 09 02:06:25 user nova-compute[75438]:     </disk>
Nov 09 02:06:25 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:06:25 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:25 user nova-compute[75438]:       <source dev="/dev/sdf"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <serial>9d2c9c45-5469-4d50-8f4a-e44f38905059</serial>
Nov 09 02:06:25 user nova-compute[75438]:     </disk>
Nov 09 02:06:25 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:06:25 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:25 user nova-compute[75438]:       <source dev="/dev/sdg"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <serial>7838b1b5-648a-460b-bdb2-88c8f09553bd</serial>
Nov 09 02:06:25 user nova-compute[75438]:     </disk>
Nov 09 02:06:25 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:06:25 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:25 user nova-compute[75438]:       <source dev="/dev/sdh"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="vdc" bus="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <serial>1ddacd56-1b95-4f96-9077-a7b613f19679</serial>
Nov 09 02:06:25 user nova-compute[75438]:     </disk>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:ee:9b:bc"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tapad8c5704-eb"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:bc:7c:12"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tap2907c1c0-6a"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:a6:16:b2"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tapd88f402e-ff"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:83:1d:f7"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tap5b43caae-cb"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:c8:11:1a"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tap86e311b5-32"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:bd:f5:af"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tap59faaff1-46"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:06:25 user nova-compute[75438]:       <mac address="fa:16:3e:05:ba:da"/>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:06:25 user nova-compute[75438]:       <target dev="tapb8b1235a-e3"/>
Nov 09 02:06:25 user nova-compute[75438]:     </interface>
Nov 09 02:06:25 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:06:25 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e/console.log" append="off"/>
Nov 09 02:06:25 user nova-compute[75438]:     </serial>
Nov 09 02:06:25 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:06:25 user nova-compute[75438]:     <video>
Nov 09 02:06:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:06:25 user nova-compute[75438]:     </video>
Nov 09 02:06:25 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:06:25 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:06:25 user nova-compute[75438]:     </rng>
Nov 09 02:06:25 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:06:25 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:06:25 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:06:25 user nova-compute[75438]:     </memballoon>
Nov 09 02:06:25 user nova-compute[75438]:   </devices>
Nov 09 02:06:25 user nova-compute[75438]: </domain>
Nov 09 02:06:25 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8da895e9-2c90-5f30-acf9-3d3d8931d98b', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad8c5704-eb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad8c5704-eb, col_values=(('qos', UUID('bd422472-9544-4c10-9043-eec49008a6d7')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad8c5704-eb, col_values=(('external_ids', {'iface-id': 'ad8c5704-eb79-468a-98ce-afa53f7a2b90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:9b:bc', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8feee00a-d5de-5562-93ab-ded844784ce8', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2907c1c0-6a, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2907c1c0-6a, col_values=(('qos', UUID('a16be90d-695f-466e-a5c9-7624ef2a3dbb')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2907c1c0-6a, col_values=(('external_ids', {'iface-id': '2907c1c0-6a46-4f04-8511-569ba9ba63a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:7c:12', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59ebb0dd-0bae-540a-997c-d3f26ea9221a', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd88f402e-ff, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd88f402e-ff, col_values=(('qos', UUID('f2086861-3264-4eea-adf4-489521bfd458')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd88f402e-ff, col_values=(('external_ids', {'iface-id': 'd88f402e-ff60-4542-9d92-683833d89cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:16:b2', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2420c558-934c-592e-9e6e-6760ad7d4bac', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b43caae-cb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b43caae-cb, col_values=(('qos', UUID('2884033d-711b-4046-95b9-71fe49f0759a')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b43caae-cb, col_values=(('external_ids', {'iface-id': '5b43caae-cb58-41b0-b9ab-169f1ffd5299', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:1d:f7', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25220f8c-e5f7-5a3d-a0ac-a6f7636aac0d', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86e311b5-32, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86e311b5-32, col_values=(('qos', UUID('b41f173b-d932-4348-887e-aeae895e37fa')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86e311b5-32, col_values=(('external_ids', {'iface-id': '86e311b5-32c1-41b5-98a8-4aaaac57e470', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:11:1a', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fbf1766-3094-5e63-9905-748f7779977d', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59faaff1-46, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59faaff1-46, col_values=(('qos', UUID('942e73cd-ec2d-4954-bfb2-2407f7b1b694')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59faaff1-46, col_values=(('external_ids', {'iface-id': '59faaff1-46be-4ca5-b04f-1ba05fd992fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:f5:af', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95cb9294-319a-5d69-9a37-1a1191bc6340', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8b1235a-e3, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8b1235a-e3, col_values=(('qos', UUID('7e290bd6-c74f-4570-9dd5-609a855a9046')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8b1235a-e3, col_values=(('external_ids', {'iface-id': 'b8b1235a-e337-42a8-8f96-46c00cd1422c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:ba:da', 'vm-uuid': '59435d59-9004-4df4-adb7-e88577aa257e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:25 user nova-compute[75438]: INFO os_vif [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3')
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] No BDM found with device name hda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] No VIF found with MAC fa:16:3e:ee:9b:bc, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:06:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] No VIF found with MAC fa:16:3e:c8:11:1a, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:06:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Using config drive
Nov 09 02:06:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Creating config drive at /opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e/disk.config
Nov 09 02:06:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpun9dr31y {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpun9dr31y" returned: 0 in 0.055s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:06:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance spawned successfully.
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUaLzkVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:32 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92e454-d34f-4ad6-a43b-5bb9ffdfb366]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:06:32 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb96a82-bef9-45cc-8688-11fa587d0411]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653] added
Nov 09 02:06:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5de02f6-8b41-4cb8-977c-ef92a6c1fc65]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'flavor' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5948a391-5d77-435c-bbee-9a0d99e19b23]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUaLzkVM {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Took 11.57 seconds to spawn the instance on the hypervisor.
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rUaLzkVM" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[192d7825-64d0-4866-8dc0-e2002e809f48]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rUaLzkVM'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e2ddd-436d-4467-9efd-1ca011607c80]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba570b-afa4-4726-a17e-f1603f6543df]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.compute.manager [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Took 117.15 seconds to build instance.
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4e171-f4a5-4273-8a16-7ed09f1b1f0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260]
Nov 09 02:06:32 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-80aabf35-8add-4075-880d-9f95a8fbaf36 tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "59435d59-9004-4df4-adb7-e88577aa257e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 117.253s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8392bc-e8be-4770-adec-75eb6c85899b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-95b8bf7c-ffc7-4015-84e1-8dbcc32092c4 req-08867069-2495-48c5-8528-9782f1cfb419 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-95b8bf7c-ffc7-4015-84e1-8dbcc32092c4 req-08867069-2495-48c5-8528-9782f1cfb419 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-95b8bf7c-ffc7-4015-84e1-8dbcc32092c4 req-08867069-2495-48c5-8528-9782f1cfb419 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-95b8bf7c-ffc7-4015-84e1-8dbcc32092c4 req-08867069-2495-48c5-8528-9782f1cfb419 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-95b8bf7c-ffc7-4015-84e1-8dbcc32092c4 req-08867069-2495-48c5-8528-9782f1cfb419 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING nova.compute.manager [req-95b8bf7c-ffc7-4015-84e1-8dbcc32092c4 req-08867069-2495-48c5-8528-9782f1cfb419 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 for instance with vm_state active and task_state None.
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.utils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a8116b-d3ee-4e51-8431-701812c8df60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd2c221-be99-4463-8b92-98153fad1aff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:32 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfc37f3-6489-4429-b4b4-3415c4d645ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-5ab95449-db8b-4707-8fcd-9db211138aa8 req-78dc7a8d-64f1-49e1-a019-d6712b6ddff8 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5ab95449-db8b-4707-8fcd-9db211138aa8 req-78dc7a8d-64f1-49e1-a019-d6712b6ddff8 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5ab95449-db8b-4707-8fcd-9db211138aa8 req-78dc7a8d-64f1-49e1-a019-d6712b6ddff8 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5ab95449-db8b-4707-8fcd-9db211138aa8 req-78dc7a8d-64f1-49e1-a019-d6712b6ddff8 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-5ab95449-db8b-4707-8fcd-9db211138aa8 req-78dc7a8d-64f1-49e1-a019-d6712b6ddff8 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING nova.compute.manager [req-5ab95449-db8b-4707-8fcd-9db211138aa8 req-78dc7a8d-64f1-49e1-a019-d6712b6ddff8 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 for instance with vm_state active and task_state None.
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.compute.manager [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Attaching volume 12d5308d-cae3-4796-b701-cd59e18bf553 to /dev/vdb
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4366c9c7-ff1c-4e19-bf93-3741fcb02869]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dcffa-1701-4afd-a2d0-584a321f246d]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUaLzkVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62acffb0-2e4e-4597-8dd6-c61176dac1e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-52653386-aeb0-4938-9a0e-2a4f451ac71e req-132af0b8-afb0-47ad-b861-29a24a912fd8 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-52653386-aeb0-4938-9a0e-2a4f451ac71e req-132af0b8-afb0-47ad-b861-29a24a912fd8 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-52653386-aeb0-4938-9a0e-2a4f451ac71e req-132af0b8-afb0-47ad-b861-29a24a912fd8 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-52653386-aeb0-4938-9a0e-2a4f451ac71e req-132af0b8-afb0-47ad-b861-29a24a912fd8 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-52653386-aeb0-4938-9a0e-2a4f451ac71e req-132af0b8-afb0-47ad-b861-29a24a912fd8 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING nova.compute.manager [req-52653386-aeb0-4938-9a0e-2a4f451ac71e req-132af0b8-afb0-47ad-b861-29a24a912fd8 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 for instance with vm_state active and task_state None.
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b97f5-03e3-4b92-b13d-60be4a426ef7]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.compute.manager [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Detaching volume 55eb550d-ba8f-4307-8994-92430fccef61
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.utils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.utils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08f2692-8e4a-4031-9dfe-4eaba89ef3eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2b4930-8925-432c-8966-c63fd351ec1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7aed4-a999-4fec-a3f3-4ba6a5d3434d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8185e7-521e-4c9a-99d0-2ac79db40631]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.virt.block_device [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Attempting to driver detach volume 55eb550d-ba8f-4307-8994-92430fccef61 from mountpoint /dev/vdb
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:06:32 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:06:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0f597c-aeb5-4531-a1bd-a451d16bab01]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG os_brick.utils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating existing volume attachment record: 9230ca49-81ce-460f-8f73-cde4b38035b8 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Attempting to detach device vdb from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:06:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:06:32 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:32 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:06:32 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:06:32 user nova-compute[75438]:   <serial>55eb550d-ba8f-4307-8994-92430fccef61</serial>
Nov 09 02:06:32 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 02:06:32 user nova-compute[75438]: </disk>
Nov 09 02:06:32 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:06:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully detached device vdb from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the persistent domain config.
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:06:33 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:33 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:06:33 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:06:33 user nova-compute[75438]:   <serial>55eb550d-ba8f-4307-8994-92430fccef61</serial>
Nov 09 02:06:33 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 02:06:33 user nova-compute[75438]: </disk>
Nov 09 02:06:33 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:06:33 user nova-compute[75438]: INFO nova.compute.manager [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Swapping volume f85746e7-c2e7-4e22-84a9-09c692f13714 for 3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] volume_snapshot_create: create_info: {'snapshot_id': 'bff4c479-c861-4584-ba00-c4a635a22343', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75438) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] snap xml: <domainsnapshot>
Nov 09 02:06:33 user nova-compute[75438]:   <disks>
Nov 09 02:06:33 user nova-compute[75438]:     <disk name="/dev/sde" snapshot="external" type="file">
Nov 09 02:06:33 user nova-compute[75438]:       <source file="/dev/new_file"/>
Nov 09 02:06:33 user nova-compute[75438]:     </disk>
Nov 09 02:06:33 user nova-compute[75438]:     <disk name="vda" snapshot="no"/>
Nov 09 02:06:33 user nova-compute[75438]:   </disks>
Nov 09 02:06:33 user nova-compute[75438]: </domainsnapshot>
Nov 09 02:06:33 user nova-compute[75438]:  {{(pid=75438) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] Lazy-loading 'system_metadata' on Instance uuid 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:33 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Traceback (most recent call last):
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     rv = execute(f, *args, **kwargs)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     six.reraise(c, e, tb)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     raise value
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     rv = meth(*args, **kwargs)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] 
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Traceback (most recent call last):
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     self._volume_snapshot_create(context, instance, guest,
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     rv = execute(f, *args, **kwargs)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     six.reraise(c, e, tb)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     raise value
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     rv = meth(*args, **kwargs)
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] 
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5590d9ca-b268-4825-baf5-b5e8b3d2c7fa tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] volume_snapshot_delete: delete_info: {'volume_id': 'b0d1c960-fa39-414a-82da-8d2d2a559c5f'} {{(pid=75438) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [None req-5590d9ca-b268-4825-baf5-b5e8b3d2c7fa tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Traceback (most recent call last):
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb]     if delete_info['type'] != 'qcow2':
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] KeyError: 'type'
Nov 09 02:06:33 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] 
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '23965663133613539', 'path': '/dev/sdi'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965663133613539', 'path': '/dev/sdi'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.objects.instance [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lazy-loading 'flavor' on Instance uuid 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:06:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:06:33 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:06:33 user nova-compute[75438]:   <source dev="/dev/sdi"/>
Nov 09 02:06:33 user nova-compute[75438]:   <target dev="sdc" bus="scsi"/>
Nov 09 02:06:33 user nova-compute[75438]:   <serial>826b6b7b-447d-4787-9c34-fbafad5fc653</serial>
Nov 09 02:06:33 user nova-compute[75438]:   <address type="drive" controller="0" unit="2"/>
Nov 09 02:06:33 user nova-compute[75438]: </disk>
Nov 09 02:06:33 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No BDM found with device name sda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] No VIF found with MAC fa:16:3e:4e:e9:01, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-6034e7b8-7294-4957-963d-ef18363dcc25 req-34eb66f5-e86a-4188-9f87-a0b0ec315044 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-ff7a82e1-eb9c-4aa2-bb74-52371b5c23f0 req-4eac861d-cc1a-43cd-b43f-247bf477f7ea service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ff7a82e1-eb9c-4aa2-bb74-52371b5c23f0 req-4eac861d-cc1a-43cd-b43f-247bf477f7ea service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ff7a82e1-eb9c-4aa2-bb74-52371b5c23f0 req-4eac861d-cc1a-43cd-b43f-247bf477f7ea service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ff7a82e1-eb9c-4aa2-bb74-52371b5c23f0 req-4eac861d-cc1a-43cd-b43f-247bf477f7ea service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-ff7a82e1-eb9c-4aa2-bb74-52371b5c23f0 req-4eac861d-cc1a-43cd-b43f-247bf477f7ea service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-ff7a82e1-eb9c-4aa2-bb74-52371b5c23f0 req-4eac861d-cc1a-43cd-b43f-247bf477f7ea service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:06:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:06:34 user nova-compute[75438]: WARNING nova.compute.manager [req-68ed7d7b-98ef-4230-9185-aac70bd1448b req-163ebd1d-529f-42fd-aba3-40e6f54ef544 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc for instance with vm_state active and task_state None.
Nov 09 02:06:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:06:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:06:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:06:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:06:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:53 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac is timed out.
Nov 09 02:06:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully detached device vdb from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the live domain config.
Nov 09 02:06:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qoYnsABw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:06:53 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[16207677-5516-496a-a1ec-bd07007afbe5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:06:53 user nova-compute[75438]: No targets found.
Nov 09 02:06:53 user nova-compute[75438]: iSNS:
Nov 09 02:06:53 user nova-compute[75438]: No targets found.
Nov 09 02:06:53 user nova-compute[75438]: STATIC:
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:06:53 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:06:53 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:06:53 user nova-compute[75438]: FIRMWARE:
Nov 09 02:06:53 user nova-compute[75438]: No targets found.
Nov 09 02:06:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:06:53 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:06:53 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128a41b-5093-4d41-8b69-08e5ffa671eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd348eae-fd86-4631-a54a-2692992944c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:06:53 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:06:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24135480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5281cd65-9ad7-4e6d-b19b-1e2a2b92e1f2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ea49b-c099-4c38-a89f-1cb0fdcd59d0]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5940432-8502-4608-a807-74c7ff4b3966]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[378fb1b6-3ea0-4656-963e-520adbf8de47]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab8664-db43-422f-9307-1994a868f430]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a2244b-5530-440e-b373-2e1325bab669]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260]
Nov 09 02:06:53 user nova-compute[75438]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61, portal: 172.16.0.220,3260] successful.
Nov 09 02:06:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55eb550d-ba8f-4307-8994-92430fccef61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc49dbd-1c07-4d82-96cb-b12953a6a72d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] <== disconnect_volume: return (365ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:06:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:06:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:06:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:00 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:00 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:00 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:07:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[29878158-ea8d-434b-b5c8-f24195c2252a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:07:00 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot bff4c479-c861-4584-ba00-c4a635a22343 could not be found.
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise value
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot bff4c479-c861-4584-ba00-c4a635a22343 could not be found. (HTTP 404) (Request-ID: req-ada0ddbd-dad6-40d7-b8ff-b601e62d34c9)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot bff4c479-c861-4584-ba00-c4a635a22343 could not be found.
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[80361099-bf51-4529-8957-ab5cf6fe328b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553] added
Nov 09 02:07:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server [None req-a3a1899b-fb64-4376-bf7d-b21855fa5db9 tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise value
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server 
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ee7ea-3b11-4dd9-94e5-5d15a1c0ec1d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver [None req-5590d9ca-b268-4825-baf5-b5e8b3d2c7fa tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-313184f2-9bab-4225-882b-ef1b0f4da000)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 09 02:07:01 user nova-compute[75438]: ERROR nova.virt.libvirt.driver 
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d897d846-2cd6-49f7-b7af-479abe2d30ae]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server [None req-5590d9ca-b268-4825-baf5-b5e8b3d2c7fa tempest-VolumesAssistedSnapshotsTest-1488055660 tempest-VolumesAssistedSnapshotsTest-1488055660-project] Exception during message handling: KeyError: 'type'
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 09 02:07:01 user nova-compute[75438]: ERROR oslo_messaging.rpc.server 
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMokQxc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMokQxc" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f745e05-ceca-4d55-bb20-68c68832e7f7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvMokQxc'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa7e66-404d-47a5-961c-6614161fd0fe]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e353cd9f-25bc-4205-94ea-287ba1f08910]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e70fda3-b67a-4ea4-b3d4-79eb9c3db26f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]
Nov 09 02:07:01 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e92d7f-2492-424b-8dca-558fc200f0fc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27b67e1-49a2-4015-b939-98d52a201389]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0dd607-01c3-4605-bd2a-0367d051a200]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-502a056d-8a31-4801-84f4-9952d42dd763 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 83.742s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23230623734613064', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623734613064', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.objects.instance [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'flavor' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:07:02 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:02 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:07:02 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:07:02 user nova-compute[75438]:   <serial>12d5308d-cae3-4796-b701-cd59e18bf553</serial>
Nov 09 02:07:02 user nova-compute[75438]: </disk>
Nov 09 02:07:02 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No VIF found with MAC fa:16:3e:87:5b:eb, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:07:02 user nova-compute[75438]: DEBUG nova.objects.instance [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'flavor' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed706501-a722-4232-99e6-d8f2f5346940 tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.375s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56946c36-54a8-4ab7-9799-8c2a9d648bca tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.857s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "interface-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-350cbba2-4bc6-4b04-9d14-ad385469f945" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "interface-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-350cbba2-4bc6-4b04-9d14-ad385469f945" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:03 user nova-compute[75438]: INFO nova.compute.manager [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Detaching volume b0d1c960-fa39-414a-82da-8d2d2a559c5f
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'flavor' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface> {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface> {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Attempting to detach device tap350cbba2-4b from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] detach device xml: <interface type="ethernet">
Nov 09 02:07:03 user nova-compute[75438]:   <mac address="fa:16:3e:7a:ef:90"/>
Nov 09 02:07:03 user nova-compute[75438]:   <model type="virtio"/>
Nov 09 02:07:03 user nova-compute[75438]:   <mtu size="1442"/>
Nov 09 02:07:03 user nova-compute[75438]:   <target dev="tap350cbba2-4b"/>
Nov 09 02:07:03 user nova-compute[75438]: </interface>
Nov 09 02:07:03 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface> {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 09 02:07:03 user nova-compute[75438]:   <name>instance-00000008</name>
Nov 09 02:07:03 user nova-compute[75438]:   <uuid>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</uuid>
Nov 09 02:07:03 user nova-compute[75438]:   <metadata>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:03 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:07:03 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:07:03 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:05:02</nova:creationTime>
Nov 09 02:07:03 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:07:03 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:03 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:07:03 user nova-compute[75438]:   <nova:owner>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:07:03 user nova-compute[75438]:   </nova:owner>
Nov 09 02:07:03 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:03 user nova-compute[75438]:   <nova:ports>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:07:03 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:07:03 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:03 user nova-compute[75438]:     <nova:port uuid="350cbba2-4bc6-4b04-9d14-ad385469f945">
Nov 09 02:07:03 user nova-compute[75438]:       <nova:ip type="fixed" address="10.10.10.173" ipVersion="4"/>
Nov 09 02:07:03 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:03 user nova-compute[75438]:   </nova:ports>
Nov 09 02:07:03 user nova-compute[75438]: </nova:instance>
Nov 09 02:07:03 user nova-compute[75438]:   </metadata>
Nov 09 02:07:03 user nova-compute[75438]:   <memory unit='KiB'>524288</memory>
Nov 09 02:07:03 user nova-compute[75438]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 02:07:03 user nova-compute[75438]:   <vcpu placement='static'>1</vcpu>
Nov 09 02:07:03 user nova-compute[75438]:   <resource>
Nov 09 02:07:03 user nova-compute[75438]:     <partition>/machine</partition>
Nov 09 02:07:03 user nova-compute[75438]:   </resource>
Nov 09 02:07:03 user nova-compute[75438]:   <sysinfo type='smbios'>
Nov 09 02:07:03 user nova-compute[75438]:     <system>
Nov 09 02:07:03 user nova-compute[75438]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 02:07:03 user nova-compute[75438]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 02:07:03 user nova-compute[75438]:       <entry name='version'>0.0.0</entry>
Nov 09 02:07:03 user nova-compute[75438]:       <entry name='serial'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:03 user nova-compute[75438]:       <entry name='uuid'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:03 user nova-compute[75438]:       <entry name='family'>Virtual Machine</entry>
Nov 09 02:07:03 user nova-compute[75438]:     </system>
Nov 09 02:07:03 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:03 user nova-compute[75438]:   <os>
Nov 09 02:07:03 user nova-compute[75438]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 02:07:03 user nova-compute[75438]:     <boot dev='hd'/>
Nov 09 02:07:03 user nova-compute[75438]:     <smbios mode='sysinfo'/>
Nov 09 02:07:03 user nova-compute[75438]:   </os>
Nov 09 02:07:03 user nova-compute[75438]:   <features>
Nov 09 02:07:03 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:03 user nova-compute[75438]:     <apic/>
Nov 09 02:07:03 user nova-compute[75438]:     <vmcoreinfo state='on'/>
Nov 09 02:07:03 user nova-compute[75438]:   </features>
Nov 09 02:07:03 user nova-compute[75438]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 02:07:03 user nova-compute[75438]:     <model fallback='forbid'>Nehalem</model>
Nov 09 02:07:03 user nova-compute[75438]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 02:07:03 user nova-compute[75438]:     <feature policy='require' name='vme'/>
Nov 09 02:07:03 user nova-compute[75438]:     <feature policy='require' name='x2apic'/>
Nov 09 02:07:03 user nova-compute[75438]:     <feature policy='require' name='hypervisor'/>
Nov 09 02:07:03 user nova-compute[75438]:   </cpu>
Nov 09 02:07:03 user nova-compute[75438]:   <clock offset='utc'>
Nov 09 02:07:03 user nova-compute[75438]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 02:07:03 user nova-compute[75438]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 02:07:03 user nova-compute[75438]:     <timer name='hpet' present='no'/>
Nov 09 02:07:03 user nova-compute[75438]:   </clock>
Nov 09 02:07:03 user nova-compute[75438]:   <on_poweroff>destroy</on_poweroff>
Nov 09 02:07:03 user nova-compute[75438]:   <on_reboot>restart</on_reboot>
Nov 09 02:07:03 user nova-compute[75438]:   <on_crash>destroy</on_crash>
Nov 09 02:07:03 user nova-compute[75438]:   <devices>
Nov 09 02:07:03 user nova-compute[75438]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 02:07:03 user nova-compute[75438]:     <disk type='file' device='disk'>
Nov 09 02:07:03 user nova-compute[75438]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 02:07:03 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk' index='2'/>
Nov 09 02:07:03 user nova-compute[75438]:       <backingStore type='file' index='3'>
Nov 09 02:07:03 user nova-compute[75438]:         <format type='raw'/>
Nov 09 02:07:03 user nova-compute[75438]:         <source file='/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399'/>
Nov 09 02:07:03 user nova-compute[75438]:         <backingStore/>
Nov 09 02:07:03 user nova-compute[75438]:       </backingStore>
Nov 09 02:07:03 user nova-compute[75438]:       <target dev='vda' bus='virtio'/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='virtio-disk0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </disk>
Nov 09 02:07:03 user nova-compute[75438]:     <disk type='file' device='cdrom'>
Nov 09 02:07:03 user nova-compute[75438]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 02:07:03 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config' index='1'/>
Nov 09 02:07:03 user nova-compute[75438]:       <backingStore/>
Nov 09 02:07:03 user nova-compute[75438]:       <target dev='hda' bus='ide'/>
Nov 09 02:07:03 user nova-compute[75438]:       <readonly/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='ide0-0-0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </disk>
Nov 09 02:07:03 user nova-compute[75438]:     <controller type='usb' index='0' model='none'>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='usb'/>
Nov 09 02:07:03 user nova-compute[75438]:     </controller>
Nov 09 02:07:03 user nova-compute[75438]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='pci.0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </controller>
Nov 09 02:07:03 user nova-compute[75438]:     <controller type='ide' index='0'>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='ide'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 02:07:03 user nova-compute[75438]:     </controller>
Nov 09 02:07:03 user nova-compute[75438]:     <interface type='ethernet'>
Nov 09 02:07:03 user nova-compute[75438]:       <mac address='fa:16:3e:b4:98:b3'/>
Nov 09 02:07:03 user nova-compute[75438]:       <target dev='tapc29727fb-92'/>
Nov 09 02:07:03 user nova-compute[75438]:       <model type='virtio'/>
Nov 09 02:07:03 user nova-compute[75438]:       <mtu size='1442'/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='net0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </interface>
Nov 09 02:07:03 user nova-compute[75438]:     <interface type='ethernet'>
Nov 09 02:07:03 user nova-compute[75438]:       <mac address='fa:16:3e:7a:ef:90'/>
Nov 09 02:07:03 user nova-compute[75438]:       <target dev='tap350cbba2-4b'/>
Nov 09 02:07:03 user nova-compute[75438]:       <model type='virtio'/>
Nov 09 02:07:03 user nova-compute[75438]:       <mtu size='1442'/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='net1'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </interface>
Nov 09 02:07:03 user nova-compute[75438]:     <serial type='pty'>
Nov 09 02:07:03 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:03 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:03 user nova-compute[75438]:       <target type='isa-serial' port='0'>
Nov 09 02:07:03 user nova-compute[75438]:         <model name='isa-serial'/>
Nov 09 02:07:03 user nova-compute[75438]:       </target>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </serial>
Nov 09 02:07:03 user nova-compute[75438]:     <console type='pty' tty='/dev/pts/8'>
Nov 09 02:07:03 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:03 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:03 user nova-compute[75438]:       <target type='serial' port='0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </console>
Nov 09 02:07:03 user nova-compute[75438]:     <input type='mouse' bus='ps2'>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='input0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </input>
Nov 09 02:07:03 user nova-compute[75438]:     <input type='keyboard' bus='ps2'>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='input1'/>
Nov 09 02:07:03 user nova-compute[75438]:     </input>
Nov 09 02:07:03 user nova-compute[75438]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 09 02:07:03 user nova-compute[75438]:       <listen type='address' address='0.0.0.0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </graphics>
Nov 09 02:07:03 user nova-compute[75438]:     <audio id='1' type='none'/>
Nov 09 02:07:03 user nova-compute[75438]:     <video>
Nov 09 02:07:03 user nova-compute[75438]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='video0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </video>
Nov 09 02:07:03 user nova-compute[75438]:     <memballoon model='virtio'>
Nov 09 02:07:03 user nova-compute[75438]:       <stats period='10'/>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='balloon0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:03 user nova-compute[75438]:     <rng model='virtio'>
Nov 09 02:07:03 user nova-compute[75438]:       <backend model='random'>/dev/urandom</backend>
Nov 09 02:07:03 user nova-compute[75438]:       <alias name='rng0'/>
Nov 09 02:07:03 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 02:07:03 user nova-compute[75438]:     </rng>
Nov 09 02:07:03 user nova-compute[75438]:   </devices>
Nov 09 02:07:03 user nova-compute[75438]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 02:07:03 user nova-compute[75438]:     <label>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</label>
Nov 09 02:07:03 user nova-compute[75438]:     <imagelabel>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</imagelabel>
Nov 09 02:07:03 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:03 user nova-compute[75438]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 02:07:03 user nova-compute[75438]:     <label>+64055:+108</label>
Nov 09 02:07:03 user nova-compute[75438]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 02:07:03 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:03 user nova-compute[75438]: </domain>
Nov 09 02:07:03 user nova-compute[75438]:  {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 02:07:03 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully detached device tap350cbba2-4b from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the persistent domain config.
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] (1/8): Attempting to detach device tap350cbba2-4b with device alias net1 from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] detach device xml: <interface type="ethernet">
Nov 09 02:07:03 user nova-compute[75438]:   <mac address="fa:16:3e:7a:ef:90"/>
Nov 09 02:07:03 user nova-compute[75438]:   <model type="virtio"/>
Nov 09 02:07:03 user nova-compute[75438]:   <mtu size="1442"/>
Nov 09 02:07:03 user nova-compute[75438]:   <target dev="tap350cbba2-4b"/>
Nov 09 02:07:03 user nova-compute[75438]: </interface>
Nov 09 02:07:03 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:07:03 user nova-compute[75438]: INFO nova.virt.block_device [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Attempting to driver detach volume b0d1c960-fa39-414a-82da-8d2d2a559c5f from mountpoint /dev/vdb
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Attempting to detach device vdb from instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] detach device xml: <disk type="block" device="disk">
Nov 09 02:07:03 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:03 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:07:03 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:07:03 user nova-compute[75438]:   <serial>b0d1c960-fa39-414a-82da-8d2d2a559c5f</serial>
Nov 09 02:07:03 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:07:03 user nova-compute[75438]: </disk>
Nov 09 02:07:03 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:03 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Successfully detached device vdb from instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb from the persistent domain config.
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] detach device xml: <disk type="block" device="disk">
Nov 09 02:07:03 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:03 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:07:03 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:07:03 user nova-compute[75438]:   <serial>b0d1c960-fa39-414a-82da-8d2d2a559c5f</serial>
Nov 09 02:07:03 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:07:03 user nova-compute[75438]: </disk>
Nov 09 02:07:03 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Start waiting for the detach event from libvirt for device tap350cbba2-4b with device alias net1 for instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-27a40356-945f-4145-be64-e09273a819da req-00f147aa-ae70-45e4-a9db-1c96ecc96d34 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-unplugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-27a40356-945f-4145-be64-e09273a819da req-00f147aa-ae70-45e4-a9db-1c96ecc96d34 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-27a40356-945f-4145-be64-e09273a819da req-00f147aa-ae70-45e4-a9db-1c96ecc96d34 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-27a40356-945f-4145-be64-e09273a819da req-00f147aa-ae70-45e4-a9db-1c96ecc96d34 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-27a40356-945f-4145-be64-e09273a819da req-00f147aa-ae70-45e4-a9db-1c96ecc96d34 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-unplugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:04 user nova-compute[75438]: WARNING nova.compute.manager [req-27a40356-945f-4145-be64-e09273a819da req-00f147aa-ae70-45e4-a9db-1c96ecc96d34 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-unplugged-350cbba2-4bc6-4b04-9d14-ad385469f945 for instance with vm_state active and task_state None.
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:04 user nova-compute[75438]: INFO nova.compute.manager [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Detaching volume 826b6b7b-447d-4787-9c34-fbafad5fc653
Nov 09 02:07:04 user nova-compute[75438]: INFO nova.virt.block_device [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Attempting to driver detach volume 826b6b7b-447d-4787-9c34-fbafad5fc653 from mountpoint /dev/sdc
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Attempting to detach device sdc from instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:07:04 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:04 user nova-compute[75438]:   <source dev="/dev/sdi"/>
Nov 09 02:07:04 user nova-compute[75438]:   <target dev="sdc" bus="scsi"/>
Nov 09 02:07:04 user nova-compute[75438]:   <serial>826b6b7b-447d-4787-9c34-fbafad5fc653</serial>
Nov 09 02:07:04 user nova-compute[75438]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 09 02:07:04 user nova-compute[75438]: </disk>
Nov 09 02:07:04 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:07:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Successfully detached device sdc from instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 from the persistent domain config.
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:07:04 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:04 user nova-compute[75438]:   <source dev="/dev/sdi"/>
Nov 09 02:07:04 user nova-compute[75438]:   <target dev="sdc" bus="scsi"/>
Nov 09 02:07:04 user nova-compute[75438]:   <serial>826b6b7b-447d-4787-9c34-fbafad5fc653</serial>
Nov 09 02:07:04 user nova-compute[75438]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 09 02:07:04 user nova-compute[75438]: </disk>
Nov 09 02:07:04 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:07:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:07:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-f39762b0-6510-4dec-a105-0a6db89a103c req-be4dd300-6e53-4a40-b11c-2a2346443399 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f39762b0-6510-4dec-a105-0a6db89a103c req-be4dd300-6e53-4a40-b11c-2a2346443399 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f39762b0-6510-4dec-a105-0a6db89a103c req-be4dd300-6e53-4a40-b11c-2a2346443399 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f39762b0-6510-4dec-a105-0a6db89a103c req-be4dd300-6e53-4a40-b11c-2a2346443399 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-f39762b0-6510-4dec-a105-0a6db89a103c req-be4dd300-6e53-4a40-b11c-2a2346443399 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:06 user nova-compute[75438]: WARNING nova.compute.manager [req-f39762b0-6510-4dec-a105-0a6db89a103c req-be4dd300-6e53-4a40-b11c-2a2346443399 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-plugged-350cbba2-4bc6-4b04-9d14-ad385469f945 for instance with vm_state active and task_state None.
Nov 09 02:07:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Stashing vm_state: active {{(pid=75438) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:07:07 user nova-compute[75438]: INFO nova.compute.claims [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Claim successful on node user
Nov 09 02:07:07 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating resource usage from migration 569b60e8-4339-4c03-a366-3a1dd586639f
Nov 09 02:07:07 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.567s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:07 user nova-compute[75438]: INFO nova.compute.manager [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Migrating
Nov 09 02:07:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:07:07 user nova-compute[75438]: INFO nova.compute.rpcapi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 09 02:07:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:07:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Starting migrate_disk_and_power_off {{(pid=75438) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-2a543f10-573a-4871-b9a2-b3995b760542 req-7a40d07f-c90a-420d-8099-58ad1a60c655 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2a543f10-573a-4871-b9a2-b3995b760542 req-7a40d07f-c90a-420d-8099-58ad1a60c655 service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2a543f10-573a-4871-b9a2-b3995b760542 req-7a40d07f-c90a-420d-8099-58ad1a60c655 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2a543f10-573a-4871-b9a2-b3995b760542 req-7a40d07f-c90a-420d-8099-58ad1a60c655 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-2a543f10-573a-4871-b9a2-b3995b760542 req-7a40d07f-c90a-420d-8099-58ad1a60c655 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:08 user nova-compute[75438]: WARNING nova.compute.manager [req-2a543f10-573a-4871-b9a2-b3995b760542 req-7a40d07f-c90a-420d-8099-58ad1a60c655 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state active and task_state resize_migrating.
Nov 09 02:07:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance destroyed successfully.
Nov 09 02:07:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8b67f2-a6, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7de4603f-4cb7-46e9-810a-5715be77d620) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:09 user nova-compute[75438]: INFO os_vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6')
Nov 09 02:07:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:09 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56eb68e-e7f6-4843-9547-acb18459b01c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:07:09 user nova-compute[75438]: No targets found.
Nov 09 02:07:09 user nova-compute[75438]: iSNS:
Nov 09 02:07:09 user nova-compute[75438]: No targets found.
Nov 09 02:07:09 user nova-compute[75438]: STATIC:
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:07:09 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:09 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:09 user nova-compute[75438]: FIRMWARE:
Nov 09 02:07:09 user nova-compute[75438]: No targets found.
Nov 09 02:07:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:07:09 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:07:09 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220c3e4-e291-4604-aa18-5f7332939036]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe56d51-7d90-4193-bdc9-60bb90fd81e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:09 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24582ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6a5c0b-47e1-4a59-8c41-39861af768c6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0a333b-83f9-4df8-a23b-16348b9b8c6b]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2945fc-016a-42ba-960c-88e75431ed55]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b4abb-3079-4055-a49b-2f26a9ed3d85]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f5c3b-c195-40bc-82f2-308079e925f5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9320cdb-b579-43b7-820d-4ab0d3582896]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]
Nov 09 02:07:09 user nova-compute[75438]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f685908e-23b3-49c2-86dc-fac94e7654b7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== disconnect_volume: return (366ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93_resize/disk /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "cp -r /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93_resize/disk /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk" returned: 0 in 0.349s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93_resize/disk.info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk.info {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "cp -r /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93_resize/disk.info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk.info" returned: 0 in 0.033s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5b256d4-0cd7-498a-9f1a-82b541adc089 req-a4c08a13-6c57-48fe-ac3f-087cb14a90d6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5b256d4-0cd7-498a-9f1a-82b541adc089 req-a4c08a13-6c57-48fe-ac3f-087cb14a90d6 service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5b256d4-0cd7-498a-9f1a-82b541adc089 req-a4c08a13-6c57-48fe-ac3f-087cb14a90d6 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5b256d4-0cd7-498a-9f1a-82b541adc089 req-a4c08a13-6c57-48fe-ac3f-087cb14a90d6 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5b256d4-0cd7-498a-9f1a-82b541adc089 req-a4c08a13-6c57-48fe-ac3f-087cb14a90d6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:10 user nova-compute[75438]: WARNING nova.compute.manager [req-f5b256d4-0cd7-498a-9f1a-82b541adc089 req-a4c08a13-6c57-48fe-ac3f-087cb14a90d6 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state active and task_state resize_migrating.
Nov 09 02:07:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Port 9c8b67f2-a61a-4580-85c9-ee3583275dc7 binding to destination host user is already ACTIVE {{(pid=75438) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 02:07:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG nova.network.neutron [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG nova.network.neutron [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG os_brick.utils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6fd61d-27a2-4278-8f8a-d85d71805abb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9d84d-5861-405d-b9f5-4fc0803a0df7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13bd9a-484e-475d-895f-f26f4eca2db2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8f0390-f096-42cd-b3ca-bc686ca9c113]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:07:12 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:07:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[23acd3fa-d9dc-4332-ba3f-ca90fcea8201]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:07:12 user nova-compute[75438]: DEBUG os_brick.utils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNUeiPEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58220e40-bfca-4be5-a3af-d1011f77e1a8', 'attached_at': '', 'detached_at': '', 'volume_id': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'serial': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '58220e40-bfca-4be5-a3af-d1011f77e1a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f85746e7-c2e7-4e22-84a9-09c692f13714', 'serial'} {{(pid=75438) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNUeiPEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:17 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:17 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:17 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[420c07b6-f332-4593-b975-eee7f6e13f86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:07:17 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df43b62-ef66-4342-a5b0-019ee9ffdb9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1] added
Nov 09 02:07:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[317ab7da-8df9-4df8-9420-110729c157bd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44ae58a-ebfd-46a9-99c5-46a0afde07d4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNUeiPEj {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WNUeiPEj" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3873da-e80a-4779-b661-a6c637b061d6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WNUeiPEj'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d5c9dd-4297-4e20-a502-033ebab8b6e1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20abbe2-b5e4-48d1-9b14-40eeb97ed376]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:07:17 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Creating image(s)
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Ensure instance console log exists: /opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Start _get_guest_xml network_info=[{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '1788a4d7-baeb-4994-a290-9dd0a62bd431', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWGpZPvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5cce59b-1c51-4e0d-998b-c42781fcc388', 'serial': 'd5cce59b-1c51-4e0d-998b-c42781fcc388'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '01cb8213-b7f8-4611-9830-99d244b7d916', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRNJmghT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce80beed-d13a-4405-83df-f450d331b989', 'serial': 'ce80beed-d13a-4405-83df-f450d331b989'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': 'cc5c4e05-d22a-4cad-8f7a-4f597acb97dc', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDEWHRyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf', 'attached_at': '', 'detached_at': '', 'volume_id': '8ee8bf43-ffec-4594-8286-830dea8c3a0b', 'serial': '8ee8bf43-ffec-4594-8286-830dea8c3a0b'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b8e94d-c8ee-4647-8be0-1515bea0d485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260]
Nov 09 02:07:17 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:17 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWGpZPvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:17 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a21cd2-c88a-4ec6-8051-cd803881fc12]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da3181-f050-41c6-8323-185d0d31dd21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:17 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236f2dd-358d-4bad-abaf-c36bad21118d]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNUeiPEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23939643635386365', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939643635386365', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.073s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:18 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:18 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lazy-loading 'flavor' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9e48fd-b1c7-407b-aa98-28de07e8942f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:07:18 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c7570-ac28-43b3-ad95-77299880410c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388] added
Nov 09 02:07:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3407b06-f1e9-4f91-9917-68f3d70d858b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[875715e5-ddfc-4198-84b5-c8292e5be09a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UWGpZPvC {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UWGpZPvC" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c81c06-1ba2-41e7-ae4e-70b317899534]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UWGpZPvC'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8efaf06-c91b-4784-89ae-663c5f770f4f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa0e987-a4a8-4926-9c51-d74bfa81f688]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:18 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[af227a4f-152e-4859-8b13-1dea011cc082]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260]
Nov 09 02:07:18 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[17836d59-efa8-44a3-b2c5-874fe2662018]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77f8b1-e245-40b9-91a4-1dc52e1b10f6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:19 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:19 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[32229d25-1cbe-4cf6-9210-237b60b66e4d]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWGpZPvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== connect_volume: return (2482ms) {'type': 'block', 'scsi_wwn': '26261363730396465', 'path': '/dev/sdj'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261363730396465', 'path': '/dev/sdj'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRNJmghT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:20 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8a1d97-90cc-4552-8f23-61e9f5354d95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:07:20 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[371de91f-e093-43ef-ace9-2e0c418458aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989] added
Nov 09 02:07:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 230686720 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fbdc95-bb7d-4596-ba1c-e92c0e21e3c9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb6486-6c94-4aad-aa7b-01c981961916]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRNJmghT {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRNJmghT" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74002cf-dff4-448f-bf8f-62b70b69a8bc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRNJmghT'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[37245db6-b998-4a85-adc5-b2def9c7f53b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b16ea5-72c5-4904-84f4-0b8564f1cd09]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:20 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 333447168 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 484442112 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.311s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --login" returned: 0 in 1.094s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15b32f-7564-4344-949b-5d62acab531c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260]
Nov 09 02:07:21 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[befef1b2-e054-414a-bb43-5d705edca04a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c932e8-3ee8-417e-8468-0fb98ab53b95]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:21 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.519s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] HCTL ('42', '-', '-', 0) found on session 14 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1416d2cf-173d-4213-a6b1-f574a16ec154]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 631242752 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 789577728 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Searching for a device in session 14 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRNJmghT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.584s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== connect_volume: return (2587ms) {'type': 'block', 'scsi_wwn': '23630616466393830', 'path': '/dev/sdk'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630616466393830', 'path': '/dev/sdk'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDEWHRyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:22 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 921698304 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53cb19a-54be-4e01-9a04-ea930a8a405f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:07:22 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5df3e7-c54b-443d-970c-abd3cb51c545]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b] added
Nov 09 02:07:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17f62fa-1956-44d6-97cd-2c5f2eb60470]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[443314f5-3ec0-44fe-b1dd-caf3205b39f1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDEWHRyG {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QDEWHRyG" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf48bbd-c439-46ae-81d3-13c1cea24760]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QDEWHRyG'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[509ffc2d-0926-4dcc-acef-3be69a613079]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[38246f8f-7cc7-4113-b921-6ed99f005ecb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: INFO nova.compute.manager [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Terminating instance
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ddd16-1df1-43d2-86ee-e05fa1f5a29f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260]
Nov 09 02:07:23 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[67562aaa-94c7-45fc-a683-f23f83328b9e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 1044381696 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fee0a39-885c-47a5-9e31-f16a98df8e9f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:23 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.550s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] HCTL ('43', '-', '-', 0) found on session 15 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d486835f-2f0f-4085-9525-f19216a0fe8e]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Searching for a device in session 15 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDEWHRyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-9fee7cc7-8ac3-4e05-b8de-f9a1ab4e8597 req-53bbb44f-9ed6-47a0-95ed-2bb09eb06927 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-vif-unplugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9fee7cc7-8ac3-4e05-b8de-f9a1ab4e8597 req-53bbb44f-9ed6-47a0-95ed-2bb09eb06927 service nova] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9fee7cc7-8ac3-4e05-b8de-f9a1ab4e8597 req-53bbb44f-9ed6-47a0-95ed-2bb09eb06927 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9fee7cc7-8ac3-4e05-b8de-f9a1ab4e8597 req-53bbb44f-9ed6-47a0-95ed-2bb09eb06927 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-9fee7cc7-8ac3-4e05-b8de-f9a1ab4e8597 req-53bbb44f-9ed6-47a0-95ed-2bb09eb06927 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] No waiting events found dispatching network-vif-unplugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-9fee7cc7-8ac3-4e05-b8de-f9a1ab4e8597 req-53bbb44f-9ed6-47a0-95ed-2bb09eb06927 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-vif-unplugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:07:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Waiting for libvirt event about the detach of device tap350cbba2-4b with device alias net1 from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac is timed out.
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface> {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 02:07:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 09 02:07:23 user nova-compute[75438]:   <name>instance-00000008</name>
Nov 09 02:07:23 user nova-compute[75438]:   <uuid>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</uuid>
Nov 09 02:07:23 user nova-compute[75438]:   <metadata>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:23 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:07:23 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:07:23 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:05:02</nova:creationTime>
Nov 09 02:07:23 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:07:23 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:23 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:07:23 user nova-compute[75438]:   <nova:owner>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:07:23 user nova-compute[75438]:   </nova:owner>
Nov 09 02:07:23 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:23 user nova-compute[75438]:   <nova:ports>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:07:23 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:07:23 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:23 user nova-compute[75438]:     <nova:port uuid="350cbba2-4bc6-4b04-9d14-ad385469f945">
Nov 09 02:07:23 user nova-compute[75438]:       <nova:ip type="fixed" address="10.10.10.173" ipVersion="4"/>
Nov 09 02:07:23 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:23 user nova-compute[75438]:   </nova:ports>
Nov 09 02:07:23 user nova-compute[75438]: </nova:instance>
Nov 09 02:07:23 user nova-compute[75438]:   </metadata>
Nov 09 02:07:23 user nova-compute[75438]:   <memory unit='KiB'>524288</memory>
Nov 09 02:07:23 user nova-compute[75438]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 02:07:23 user nova-compute[75438]:   <vcpu placement='static'>1</vcpu>
Nov 09 02:07:23 user nova-compute[75438]:   <resource>
Nov 09 02:07:23 user nova-compute[75438]:     <partition>/machine</partition>
Nov 09 02:07:23 user nova-compute[75438]:   </resource>
Nov 09 02:07:23 user nova-compute[75438]:   <sysinfo type='smbios'>
Nov 09 02:07:23 user nova-compute[75438]:     <system>
Nov 09 02:07:23 user nova-compute[75438]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 02:07:23 user nova-compute[75438]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 02:07:23 user nova-compute[75438]:       <entry name='version'>0.0.0</entry>
Nov 09 02:07:23 user nova-compute[75438]:       <entry name='serial'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:23 user nova-compute[75438]:       <entry name='uuid'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:23 user nova-compute[75438]:       <entry name='family'>Virtual Machine</entry>
Nov 09 02:07:23 user nova-compute[75438]:     </system>
Nov 09 02:07:23 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:23 user nova-compute[75438]:   <os>
Nov 09 02:07:23 user nova-compute[75438]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 02:07:23 user nova-compute[75438]:     <boot dev='hd'/>
Nov 09 02:07:23 user nova-compute[75438]:     <smbios mode='sysinfo'/>
Nov 09 02:07:23 user nova-compute[75438]:   </os>
Nov 09 02:07:23 user nova-compute[75438]:   <features>
Nov 09 02:07:23 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:23 user nova-compute[75438]:     <apic/>
Nov 09 02:07:23 user nova-compute[75438]:     <vmcoreinfo state='on'/>
Nov 09 02:07:23 user nova-compute[75438]:   </features>
Nov 09 02:07:23 user nova-compute[75438]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 02:07:23 user nova-compute[75438]:     <model fallback='forbid'>Nehalem</model>
Nov 09 02:07:23 user nova-compute[75438]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 02:07:23 user nova-compute[75438]:     <feature policy='require' name='vme'/>
Nov 09 02:07:23 user nova-compute[75438]:     <feature policy='require' name='x2apic'/>
Nov 09 02:07:23 user nova-compute[75438]:     <feature policy='require' name='hypervisor'/>
Nov 09 02:07:23 user nova-compute[75438]:   </cpu>
Nov 09 02:07:23 user nova-compute[75438]:   <clock offset='utc'>
Nov 09 02:07:23 user nova-compute[75438]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 02:07:23 user nova-compute[75438]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 02:07:23 user nova-compute[75438]:     <timer name='hpet' present='no'/>
Nov 09 02:07:23 user nova-compute[75438]:   </clock>
Nov 09 02:07:23 user nova-compute[75438]:   <on_poweroff>destroy</on_poweroff>
Nov 09 02:07:23 user nova-compute[75438]:   <on_reboot>restart</on_reboot>
Nov 09 02:07:23 user nova-compute[75438]:   <on_crash>destroy</on_crash>
Nov 09 02:07:23 user nova-compute[75438]:   <devices>
Nov 09 02:07:23 user nova-compute[75438]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 02:07:23 user nova-compute[75438]:     <disk type='file' device='disk'>
Nov 09 02:07:23 user nova-compute[75438]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 02:07:23 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk' index='2'/>
Nov 09 02:07:23 user nova-compute[75438]:       <backingStore type='file' index='3'>
Nov 09 02:07:23 user nova-compute[75438]:         <format type='raw'/>
Nov 09 02:07:23 user nova-compute[75438]:         <source file='/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399'/>
Nov 09 02:07:23 user nova-compute[75438]:         <backingStore/>
Nov 09 02:07:23 user nova-compute[75438]:       </backingStore>
Nov 09 02:07:23 user nova-compute[75438]:       <target dev='vda' bus='virtio'/>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='virtio-disk0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </disk>
Nov 09 02:07:23 user nova-compute[75438]:     <disk type='file' device='cdrom'>
Nov 09 02:07:23 user nova-compute[75438]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 02:07:23 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config' index='1'/>
Nov 09 02:07:23 user nova-compute[75438]:       <backingStore/>
Nov 09 02:07:23 user nova-compute[75438]:       <target dev='hda' bus='ide'/>
Nov 09 02:07:23 user nova-compute[75438]:       <readonly/>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='ide0-0-0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </disk>
Nov 09 02:07:23 user nova-compute[75438]:     <controller type='usb' index='0' model='none'>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='usb'/>
Nov 09 02:07:23 user nova-compute[75438]:     </controller>
Nov 09 02:07:23 user nova-compute[75438]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='pci.0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </controller>
Nov 09 02:07:23 user nova-compute[75438]:     <controller type='ide' index='0'>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='ide'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 02:07:23 user nova-compute[75438]:     </controller>
Nov 09 02:07:23 user nova-compute[75438]:     <interface type='ethernet'>
Nov 09 02:07:23 user nova-compute[75438]:       <mac address='fa:16:3e:b4:98:b3'/>
Nov 09 02:07:23 user nova-compute[75438]:       <target dev='tapc29727fb-92'/>
Nov 09 02:07:23 user nova-compute[75438]:       <model type='virtio'/>
Nov 09 02:07:23 user nova-compute[75438]:       <mtu size='1442'/>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='net0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </interface>
Nov 09 02:07:23 user nova-compute[75438]:     <serial type='pty'>
Nov 09 02:07:23 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:23 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:23 user nova-compute[75438]:       <target type='isa-serial' port='0'>
Nov 09 02:07:23 user nova-compute[75438]:         <model name='isa-serial'/>
Nov 09 02:07:23 user nova-compute[75438]:       </target>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </serial>
Nov 09 02:07:23 user nova-compute[75438]:     <console type='pty' tty='/dev/pts/8'>
Nov 09 02:07:23 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:23 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:23 user nova-compute[75438]:       <target type='serial' port='0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </console>
Nov 09 02:07:23 user nova-compute[75438]:     <input type='mouse' bus='ps2'>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='input0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </input>
Nov 09 02:07:23 user nova-compute[75438]:     <input type='keyboard' bus='ps2'>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='input1'/>
Nov 09 02:07:23 user nova-compute[75438]:     </input>
Nov 09 02:07:23 user nova-compute[75438]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 09 02:07:23 user nova-compute[75438]:       <listen type='address' address='0.0.0.0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </graphics>
Nov 09 02:07:23 user nova-compute[75438]:     <audio id='1' type='none'/>
Nov 09 02:07:23 user nova-compute[75438]:     <video>
Nov 09 02:07:23 user nova-compute[75438]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='video0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </video>
Nov 09 02:07:23 user nova-compute[75438]:     <memballoon model='virtio'>
Nov 09 02:07:23 user nova-compute[75438]:       <stats period='10'/>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='balloon0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:23 user nova-compute[75438]:     <rng model='virtio'>
Nov 09 02:07:23 user nova-compute[75438]:       <backend model='random'>/dev/urandom</backend>
Nov 09 02:07:23 user nova-compute[75438]:       <alias name='rng0'/>
Nov 09 02:07:23 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 02:07:23 user nova-compute[75438]:     </rng>
Nov 09 02:07:23 user nova-compute[75438]:   </devices>
Nov 09 02:07:23 user nova-compute[75438]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 02:07:23 user nova-compute[75438]:     <label>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</label>
Nov 09 02:07:23 user nova-compute[75438]:     <imagelabel>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</imagelabel>
Nov 09 02:07:23 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:23 user nova-compute[75438]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 02:07:23 user nova-compute[75438]:     <label>+64055:+108</label>
Nov 09 02:07:23 user nova-compute[75438]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 02:07:23 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:23 user nova-compute[75438]: </domain>
Nov 09 02:07:23 user nova-compute[75438]:  {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully detached device tap350cbba2-4b from instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac from the live domain config.
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_vif [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350cbba2-4b, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d8b6852-5809-41da-a4f0-cba9c3345c38) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:24 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Instance destroyed successfully.
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.objects.instance [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lazy-loading 'resources' on Instance uuid ad38be13-18b6-4de6-b28a-fa027946d63c {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: INFO os_vif [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b')
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:24 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:07:24 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:07:24 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:07:24</nova:creationTime>
Nov 09 02:07:24 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:07:24 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:24 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:07:24 user nova-compute[75438]:   <nova:owner>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:07:24 user nova-compute[75438]:   </nova:owner>
Nov 09 02:07:24 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:24 user nova-compute[75438]:   <nova:ports>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:07:24 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:   </nova:ports>
Nov 09 02:07:24 user nova-compute[75438]: </nova:instance>
Nov 09 02:07:24 user nova-compute[75438]:  {{(pid=75438) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1440977857',display_name='tempest-VolumesActionsTest-instance-1440977857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1440977857',id=10,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2da4c47781ed4ae8ade5c4e0921cde0a',ramdisk_id='',reservation_id='r-a0s0j0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-721255364',owner_user_name='tempest-VolumesActionsTest-721255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:32Z,user_data=None,user_id='3d6befd4ed334e93a1eadae158847415',uuid=ad38be13-18b6-4de6-b28a-fa027946d63c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Converting VIF {"id": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "address": "fa:16:3e:97:f3:76", "network": {"id": "e4a06cc3-ec04-450d-8e9d-1184f811f67d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-555716183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2da4c47781ed4ae8ade5c4e0921cde0a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad4d0bd-1c", "ovs_interfaceid": "0ad4d0bd-1c1b-43cf-800e-c62858fa97b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_vif [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ad4d0bd-1c, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcd8c1c0-20ce-4e9b-9ce0-0ea2b88d4cf2) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: INFO os_vif [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f3:76,bridge_name='br-int',has_traffic_filtering=True,id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9,network=Network(e4a06cc3-ec04-450d-8e9d-1184f811f67d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad4d0bd-1c')
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Deleting instance files /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c_del
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Deletion of /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c_del complete
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json" returned: 1 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk --force-share --output=json' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:07:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000a, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/ad38be13-18b6-4de6-b28a-fa027946d63c/disk
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.861s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== connect_volume: return (1863ms) {'type': 'block', 'scsi_wwn': '23762393737333533', 'path': '/dev/sdl'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762393737333533', 'path': '/dev/sdl'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:07:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb is timed out.
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.compute.manager [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Rescuing
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.580s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Successfully detached device vdb from instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb from the live domain config.
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkSZvcQA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:24 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.compute.manager [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394a7b6-3070-4b28-afde-1a4118c4cba4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:07:24 user nova-compute[75438]: No targets found.
Nov 09 02:07:24 user nova-compute[75438]: iSNS:
Nov 09 02:07:24 user nova-compute[75438]: No targets found.
Nov 09 02:07:24 user nova-compute[75438]: STATIC:
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:07:24 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:24 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:24 user nova-compute[75438]: FIRMWARE:
Nov 09 02:07:24 user nova-compute[75438]: No targets found.
Nov 09 02:07:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:07:24 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:07:24 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:07:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=25.261337280273438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[07845cfb-2936-4d10-9091-8fe5b5520f90]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lazy-loading 'pci_devices' on Instance uuid b029c08b-ba97-4d48-b734-d8034f7a4cdf {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:07:24 user nova-compute[75438]:   <uuid>b029c08b-ba97-4d48-b734-d8034f7a4cdf</uuid>
Nov 09 02:07:24 user nova-compute[75438]:   <name>instance-0000000b</name>
Nov 09 02:07:24 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:07:24 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:07:24 user nova-compute[75438]:   <metadata>
Nov 09 02:07:24 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:24 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:07:24 user nova-compute[75438]:       <nova:name>tempest-device-tagging-server-1954477736</nova:name>
Nov 09 02:07:24 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:07:17</nova:creationTime>
Nov 09 02:07:24 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:07:24 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:24 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:07:24 user nova-compute[75438]:       <nova:owner>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:user uuid="0d48c574bcbe49239ff3d9eedc721b10">tempest-TaggedBootDevicesTest-1212876191-project-member</nova:user>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:project uuid="2e3673ddc6f74b73a90c4cb34ec4cebd">tempest-TaggedBootDevicesTest-1212876191</nova:project>
Nov 09 02:07:24 user nova-compute[75438]:       </nova:owner>
Nov 09 02:07:24 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:24 user nova-compute[75438]:       <nova:ports>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="baa25161-34cc-4878-a6dd-45c4c921d337">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="e6139ab9-94c7-453f-94c5-7aff1ab71e36">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="d2aeb576-f698-4162-8c21-516f32d7b87e">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="73090444-eef2-45eb-adf7-9b5d92ec510b">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="7fa8c648-589d-4f5e-9eae-e2e01afd3ad2">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="9f479e5a-1ae3-432b-9d14-a51ea1e13e42">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:         <nova:port uuid="bae05ee5-b5b1-4fa9-aabf-c57fbc020d01">
Nov 09 02:07:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 09 02:07:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:24 user nova-compute[75438]:       </nova:ports>
Nov 09 02:07:24 user nova-compute[75438]:     </nova:instance>
Nov 09 02:07:24 user nova-compute[75438]:   </metadata>
Nov 09 02:07:24 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:07:24 user nova-compute[75438]:     <system>
Nov 09 02:07:24 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:07:24 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:07:24 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:07:24 user nova-compute[75438]:       <entry name="serial">b029c08b-ba97-4d48-b734-d8034f7a4cdf</entry>
Nov 09 02:07:24 user nova-compute[75438]:       <entry name="uuid">b029c08b-ba97-4d48-b734-d8034f7a4cdf</entry>
Nov 09 02:07:24 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:07:24 user nova-compute[75438]:     </system>
Nov 09 02:07:24 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:24 user nova-compute[75438]:   <os>
Nov 09 02:07:24 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:07:24 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:07:24 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:07:24 user nova-compute[75438]:   </os>
Nov 09 02:07:24 user nova-compute[75438]:   <features>
Nov 09 02:07:24 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:24 user nova-compute[75438]:     <apic/>
Nov 09 02:07:24 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:07:24 user nova-compute[75438]:   </features>
Nov 09 02:07:24 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:07:24 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:07:24 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:07:24 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:07:24 user nova-compute[75438]:   </clock>
Nov 09 02:07:24 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:07:24 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:07:24 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:07:24 user nova-compute[75438]:   </cpu>
Nov 09 02:07:24 user nova-compute[75438]:   <devices>
Nov 09 02:07:24 user nova-compute[75438]:     <disk type="file" device="cdrom">
Nov 09 02:07:24 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none"/>
Nov 09 02:07:24 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf/disk.config"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="hda" bus="ide"/>
Nov 09 02:07:24 user nova-compute[75438]:     </disk>
Nov 09 02:07:24 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:07:24 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:24 user nova-compute[75438]:       <source dev="/dev/sdj"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <serial>d5cce59b-1c51-4e0d-998b-c42781fcc388</serial>
Nov 09 02:07:24 user nova-compute[75438]:     </disk>
Nov 09 02:07:24 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:07:24 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:24 user nova-compute[75438]:       <source dev="/dev/sdk"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <serial>ce80beed-d13a-4405-83df-f450d331b989</serial>
Nov 09 02:07:24 user nova-compute[75438]:     </disk>
Nov 09 02:07:24 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:07:24 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:24 user nova-compute[75438]:       <source dev="/dev/sdl"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="vdc" bus="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <serial>8ee8bf43-ffec-4594-8286-830dea8c3a0b</serial>
Nov 09 02:07:24 user nova-compute[75438]:     </disk>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:10:df:7c"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tapbaa25161-34"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:a6:3f:ac"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tape6139ab9-94"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:d4:6d:be"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tapd2aeb576-f6"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:60:12:8b"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tap73090444-ee"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:52:fe:45"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tap7fa8c648-58"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:fd:52:05"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tap9f479e5a-1a"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:24 user nova-compute[75438]:       <mac address="fa:16:3e:b3:8e:61"/>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:24 user nova-compute[75438]:       <target dev="tapbae05ee5-b5"/>
Nov 09 02:07:24 user nova-compute[75438]:     </interface>
Nov 09 02:07:24 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:07:24 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf/console.log" append="off"/>
Nov 09 02:07:24 user nova-compute[75438]:     </serial>
Nov 09 02:07:24 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:07:24 user nova-compute[75438]:     <video>
Nov 09 02:07:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:24 user nova-compute[75438]:     </video>
Nov 09 02:07:24 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:07:24 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:07:24 user nova-compute[75438]:     </rng>
Nov 09 02:07:24 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:07:24 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:07:24 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:07:24 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:24 user nova-compute[75438]:   </devices>
Nov 09 02:07:24 user nova-compute[75438]: </domain>
Nov 09 02:07:24 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f2d43b-2680-4049-8381-63738c3f5f2e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:24 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba045ce200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c71dbe0-b9a8-5575-b1d0-72c21f8afbc6', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaa25161-34, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbaa25161-34, col_values=(('qos', UUID('d75ee219-11aa-4fed-a1f0-3d725dc60bac')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbaa25161-34, col_values=(('external_ids', {'iface-id': 'baa25161-34cc-4878-a6dd-45c4c921d337', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:df:7c', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d06e7-4e43-4c91-b812-d032aed0104d]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34')
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ecbd02d6-bec6-5135-8399-744ab8822abe', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Applying migration context for instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 as it has an incoming, in-progress migration 569b60e8-4339-4c03-a366-3a1dd586639f. Migration status is post-migrating {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 02:07:24 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating resource usage from migration 569b60e8-4339-4c03-a366-3a1dd586639f
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a54808-e6e5-4e57-8faf-4f6e5224560d]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6139ab9-94, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6139ab9-94, col_values=(('qos', UUID('b99a4f85-04ed-456e-9625-3d30eeb41611')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6139ab9-94, col_values=(('external_ids', {'iface-id': 'e6139ab9-94c7-453f-94c5-7aff1ab71e36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3f:ac', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5980db7b-edbc-4f6b-b153-1b50cd8f2f17]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ad38be13-18b6-4de6-b28a-fa027946d63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 59435d59-9004-4df4-adb7-e88577aa257e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Migration 569b60e8-4339-4c03-a366-3a1dd586639f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94')
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0f264-ef1c-4c8d-9eae-24d844afc064]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6aeb863-c44c-5148-91ab-595c247d2637', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af678c9-6d74-433d-95eb-5c66f28fec25]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2aeb576-f6, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2aeb576-f6, col_values=(('qos', UUID('93177bc8-ee15-4a00-9b08-6b5cf05f67c2')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2aeb576-f6, col_values=(('external_ids', {'iface-id': 'd2aeb576-f698-4162-8c21-516f32d7b87e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:6d:be', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6')
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-deleted-350cbba2-4bc6-4b04-9d14-ad385469f945 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:25 user nova-compute[75438]: INFO nova.compute.manager [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Neutron deleted interface 350cbba2-4bc6-4b04-9d14-ad385469f945; detaching it from the instance and deleting it from the info cache
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd85ce79c-7006-5288-84ac-f089b4e13ebf', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a65eb6-8e28-42f4-843a-2e837190ebfa]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]
Nov 09 02:07:25 user nova-compute[75438]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 is timed out.
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquired lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:07:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Successfully detached device sdc from instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 from the live domain config.
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.objects.instance [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Lazy-loading 'system_metadata' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[567144c1-2d12-48e5-b204-c96f23a19a9b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] <== disconnect_volume: return (1059ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73090444-ee, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73090444-ee, col_values=(('qos', UUID('dc3e2d12-bcf8-4867-80b3-b961dd6c7d31')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73090444-ee, col_values=(('external_ids', {'iface-id': '73090444-eef2-45eb-adf7-9b5d92ec510b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:12:8b', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.471s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rUaLzkVM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.objects.instance [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Lazy-loading 'flavor' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae01a6f-432f-4e23-a6e3-d9bb894c06e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:07:25 user nova-compute[75438]: No targets found.
Nov 09 02:07:25 user nova-compute[75438]: iSNS:
Nov 09 02:07:25 user nova-compute[75438]: No targets found.
Nov 09 02:07:25 user nova-compute[75438]: STATIC:
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: FIRMWARE:
Nov 09 02:07:25 user nova-compute[75438]: No targets found.
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:07:25 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:07:25 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.objects.base [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Object Instance<0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac> lazy-loaded attributes: system_metadata,flavor {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Converting VIF {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:25 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee')
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[076eb0b4-6b21-419c-ac80-f8f234402d4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab6dc90a-a60a-5fb6-b284-ae478bbf777d', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface> {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNUeiPEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '58220e40-bfca-4be5-a3af-d1011f77e1a8', 'attached_at': '', 'detached_at': '', 'volume_id': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'serial'} {{(pid=75438) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] swap_volume: removing Cinder connection for volume f85746e7-c2e7-4e22-84a9-09c692f13714 {{(pid=75438) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 09 02:07:25 user nova-compute[75438]:   <name>instance-00000008</name>
Nov 09 02:07:25 user nova-compute[75438]:   <uuid>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</uuid>
Nov 09 02:07:25 user nova-compute[75438]:   <metadata>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:25 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:07:24</nova:creationTime>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:07:25 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:owner>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:owner>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:ports>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:07:25 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:07:25 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:ports>
Nov 09 02:07:25 user nova-compute[75438]: </nova:instance>
Nov 09 02:07:25 user nova-compute[75438]:   </metadata>
Nov 09 02:07:25 user nova-compute[75438]:   <memory unit='KiB'>524288</memory>
Nov 09 02:07:25 user nova-compute[75438]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 02:07:25 user nova-compute[75438]:   <vcpu placement='static'>1</vcpu>
Nov 09 02:07:25 user nova-compute[75438]:   <resource>
Nov 09 02:07:25 user nova-compute[75438]:     <partition>/machine</partition>
Nov 09 02:07:25 user nova-compute[75438]:   </resource>
Nov 09 02:07:25 user nova-compute[75438]:   <sysinfo type='smbios'>
Nov 09 02:07:25 user nova-compute[75438]:     <system>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='version'>0.0.0</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='serial'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='uuid'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='family'>Virtual Machine</entry>
Nov 09 02:07:25 user nova-compute[75438]:     </system>
Nov 09 02:07:25 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:25 user nova-compute[75438]:   <os>
Nov 09 02:07:25 user nova-compute[75438]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 02:07:25 user nova-compute[75438]:     <boot dev='hd'/>
Nov 09 02:07:25 user nova-compute[75438]:     <smbios mode='sysinfo'/>
Nov 09 02:07:25 user nova-compute[75438]:   </os>
Nov 09 02:07:25 user nova-compute[75438]:   <features>
Nov 09 02:07:25 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:25 user nova-compute[75438]:     <apic/>
Nov 09 02:07:25 user nova-compute[75438]:     <vmcoreinfo state='on'/>
Nov 09 02:07:25 user nova-compute[75438]:   </features>
Nov 09 02:07:25 user nova-compute[75438]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 02:07:25 user nova-compute[75438]:     <model fallback='forbid'>Nehalem</model>
Nov 09 02:07:25 user nova-compute[75438]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 02:07:25 user nova-compute[75438]:     <feature policy='require' name='vme'/>
Nov 09 02:07:25 user nova-compute[75438]:     <feature policy='require' name='x2apic'/>
Nov 09 02:07:25 user nova-compute[75438]:     <feature policy='require' name='hypervisor'/>
Nov 09 02:07:25 user nova-compute[75438]:   </cpu>
Nov 09 02:07:25 user nova-compute[75438]:   <clock offset='utc'>
Nov 09 02:07:25 user nova-compute[75438]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 02:07:25 user nova-compute[75438]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 02:07:25 user nova-compute[75438]:     <timer name='hpet' present='no'/>
Nov 09 02:07:25 user nova-compute[75438]:   </clock>
Nov 09 02:07:25 user nova-compute[75438]:   <on_poweroff>destroy</on_poweroff>
Nov 09 02:07:25 user nova-compute[75438]:   <on_reboot>restart</on_reboot>
Nov 09 02:07:25 user nova-compute[75438]:   <on_crash>destroy</on_crash>
Nov 09 02:07:25 user nova-compute[75438]:   <devices>
Nov 09 02:07:25 user nova-compute[75438]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 02:07:25 user nova-compute[75438]:     <disk type='file' device='disk'>
Nov 09 02:07:25 user nova-compute[75438]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 02:07:25 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk' index='2'/>
Nov 09 02:07:25 user nova-compute[75438]:       <backingStore type='file' index='3'>
Nov 09 02:07:25 user nova-compute[75438]:         <format type='raw'/>
Nov 09 02:07:25 user nova-compute[75438]:         <source file='/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399'/>
Nov 09 02:07:25 user nova-compute[75438]:         <backingStore/>
Nov 09 02:07:25 user nova-compute[75438]:       </backingStore>
Nov 09 02:07:25 user nova-compute[75438]:       <target dev='vda' bus='virtio'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='virtio-disk0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </disk>
Nov 09 02:07:25 user nova-compute[75438]:     <disk type='file' device='cdrom'>
Nov 09 02:07:25 user nova-compute[75438]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 02:07:25 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config' index='1'/>
Nov 09 02:07:25 user nova-compute[75438]:       <backingStore/>
Nov 09 02:07:25 user nova-compute[75438]:       <target dev='hda' bus='ide'/>
Nov 09 02:07:25 user nova-compute[75438]:       <readonly/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='ide0-0-0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </disk>
Nov 09 02:07:25 user nova-compute[75438]:     <controller type='usb' index='0' model='none'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='usb'/>
Nov 09 02:07:25 user nova-compute[75438]:     </controller>
Nov 09 02:07:25 user nova-compute[75438]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='pci.0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </controller>
Nov 09 02:07:25 user nova-compute[75438]:     <controller type='ide' index='0'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='ide'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 02:07:25 user nova-compute[75438]:     </controller>
Nov 09 02:07:25 user nova-compute[75438]:     <interface type='ethernet'>
Nov 09 02:07:25 user nova-compute[75438]:       <mac address='fa:16:3e:b4:98:b3'/>
Nov 09 02:07:25 user nova-compute[75438]:       <target dev='tapc29727fb-92'/>
Nov 09 02:07:25 user nova-compute[75438]:       <model type='virtio'/>
Nov 09 02:07:25 user nova-compute[75438]:       <mtu size='1442'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='net0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </interface>
Nov 09 02:07:25 user nova-compute[75438]:     <serial type='pty'>
Nov 09 02:07:25 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:25 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:25 user nova-compute[75438]:       <target type='isa-serial' port='0'>
Nov 09 02:07:25 user nova-compute[75438]:         <model name='isa-serial'/>
Nov 09 02:07:25 user nova-compute[75438]:       </target>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </serial>
Nov 09 02:07:25 user nova-compute[75438]:     <console type='pty' tty='/dev/pts/8'>
Nov 09 02:07:25 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:25 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:25 user nova-compute[75438]:       <target type='serial' port='0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </console>
Nov 09 02:07:25 user nova-compute[75438]:     <input type='mouse' bus='ps2'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='input0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </input>
Nov 09 02:07:25 user nova-compute[75438]:     <input type='keyboard' bus='ps2'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='input1'/>
Nov 09 02:07:25 user nova-compute[75438]:     </input>
Nov 09 02:07:25 user nova-compute[75438]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 09 02:07:25 user nova-compute[75438]:       <listen type='address' address='0.0.0.0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </graphics>
Nov 09 02:07:25 user nova-compute[75438]:     <audio id='1' type='none'/>
Nov 09 02:07:25 user nova-compute[75438]:     <video>
Nov 09 02:07:25 user nova-compute[75438]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='video0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </video>
Nov 09 02:07:25 user nova-compute[75438]:     <memballoon model='virtio'>
Nov 09 02:07:25 user nova-compute[75438]:       <stats period='10'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='balloon0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:25 user nova-compute[75438]:     <rng model='virtio'>
Nov 09 02:07:25 user nova-compute[75438]:       <backend model='random'>/dev/urandom</backend>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='rng0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </rng>
Nov 09 02:07:25 user nova-compute[75438]:   </devices>
Nov 09 02:07:25 user nova-compute[75438]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 02:07:25 user nova-compute[75438]:     <label>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</label>
Nov 09 02:07:25 user nova-compute[75438]:     <imagelabel>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</imagelabel>
Nov 09 02:07:25 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:25 user nova-compute[75438]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 02:07:25 user nova-compute[75438]:     <label>+64055:+108</label>
Nov 09 02:07:25 user nova-compute[75438]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 02:07:25 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:25 user nova-compute[75438]: </domain>
Nov 09 02:07:25 user nova-compute[75438]:  {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface> {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:7a:ef:90"/><model type="virtio"/><mtu size="1442"/><target dev="tap350cbba2-4b"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 09 02:07:25 user nova-compute[75438]:   <name>instance-00000008</name>
Nov 09 02:07:25 user nova-compute[75438]:   <uuid>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</uuid>
Nov 09 02:07:25 user nova-compute[75438]:   <metadata>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:25 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:07:24</nova:creationTime>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:07:25 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:owner>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:owner>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:ports>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:07:25 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:07:25 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:ports>
Nov 09 02:07:25 user nova-compute[75438]: </nova:instance>
Nov 09 02:07:25 user nova-compute[75438]:   </metadata>
Nov 09 02:07:25 user nova-compute[75438]:   <memory unit='KiB'>524288</memory>
Nov 09 02:07:25 user nova-compute[75438]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 09 02:07:25 user nova-compute[75438]:   <vcpu placement='static'>1</vcpu>
Nov 09 02:07:25 user nova-compute[75438]:   <resource>
Nov 09 02:07:25 user nova-compute[75438]:     <partition>/machine</partition>
Nov 09 02:07:25 user nova-compute[75438]:   </resource>
Nov 09 02:07:25 user nova-compute[75438]:   <sysinfo type='smbios'>
Nov 09 02:07:25 user nova-compute[75438]:     <system>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='product'>OpenStack Nova</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='version'>0.0.0</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='serial'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='uuid'>0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</entry>
Nov 09 02:07:25 user nova-compute[75438]:       <entry name='family'>Virtual Machine</entry>
Nov 09 02:07:25 user nova-compute[75438]:     </system>
Nov 09 02:07:25 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:25 user nova-compute[75438]:   <os>
Nov 09 02:07:25 user nova-compute[75438]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 09 02:07:25 user nova-compute[75438]:     <boot dev='hd'/>
Nov 09 02:07:25 user nova-compute[75438]:     <smbios mode='sysinfo'/>
Nov 09 02:07:25 user nova-compute[75438]:   </os>
Nov 09 02:07:25 user nova-compute[75438]:   <features>
Nov 09 02:07:25 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:25 user nova-compute[75438]:     <apic/>
Nov 09 02:07:25 user nova-compute[75438]:     <vmcoreinfo state='on'/>
Nov 09 02:07:25 user nova-compute[75438]:   </features>
Nov 09 02:07:25 user nova-compute[75438]:   <cpu mode='custom' match='exact' check='full'>
Nov 09 02:07:25 user nova-compute[75438]:     <model fallback='forbid'>Nehalem</model>
Nov 09 02:07:25 user nova-compute[75438]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 09 02:07:25 user nova-compute[75438]:     <feature policy='require' name='vme'/>
Nov 09 02:07:25 user nova-compute[75438]:     <feature policy='require' name='x2apic'/>
Nov 09 02:07:25 user nova-compute[75438]:     <feature policy='require' name='hypervisor'/>
Nov 09 02:07:25 user nova-compute[75438]:   </cpu>
Nov 09 02:07:25 user nova-compute[75438]:   <clock offset='utc'>
Nov 09 02:07:25 user nova-compute[75438]:     <timer name='pit' tickpolicy='delay'/>
Nov 09 02:07:25 user nova-compute[75438]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 09 02:07:25 user nova-compute[75438]:     <timer name='hpet' present='no'/>
Nov 09 02:07:25 user nova-compute[75438]:   </clock>
Nov 09 02:07:25 user nova-compute[75438]:   <on_poweroff>destroy</on_poweroff>
Nov 09 02:07:25 user nova-compute[75438]:   <on_reboot>restart</on_reboot>
Nov 09 02:07:25 user nova-compute[75438]:   <on_crash>destroy</on_crash>
Nov 09 02:07:25 user nova-compute[75438]:   <devices>
Nov 09 02:07:25 user nova-compute[75438]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 09 02:07:25 user nova-compute[75438]:     <disk type='file' device='disk'>
Nov 09 02:07:25 user nova-compute[75438]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 09 02:07:25 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk' index='2'/>
Nov 09 02:07:25 user nova-compute[75438]:       <backingStore type='file' index='3'>
Nov 09 02:07:25 user nova-compute[75438]:         <format type='raw'/>
Nov 09 02:07:25 user nova-compute[75438]:         <source file='/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399'/>
Nov 09 02:07:25 user nova-compute[75438]:         <backingStore/>
Nov 09 02:07:25 user nova-compute[75438]:       </backingStore>
Nov 09 02:07:25 user nova-compute[75438]:       <target dev='vda' bus='virtio'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='virtio-disk0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </disk>
Nov 09 02:07:25 user nova-compute[75438]:     <disk type='file' device='cdrom'>
Nov 09 02:07:25 user nova-compute[75438]:       <driver name='qemu' type='raw' cache='none'/>
Nov 09 02:07:25 user nova-compute[75438]:       <source file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/disk.config' index='1'/>
Nov 09 02:07:25 user nova-compute[75438]:       <backingStore/>
Nov 09 02:07:25 user nova-compute[75438]:       <target dev='hda' bus='ide'/>
Nov 09 02:07:25 user nova-compute[75438]:       <readonly/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='ide0-0-0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </disk>
Nov 09 02:07:25 user nova-compute[75438]:     <controller type='usb' index='0' model='none'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='usb'/>
Nov 09 02:07:25 user nova-compute[75438]:     </controller>
Nov 09 02:07:25 user nova-compute[75438]:     <controller type='pci' index='0' model='pci-root'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='pci.0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </controller>
Nov 09 02:07:25 user nova-compute[75438]:     <controller type='ide' index='0'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='ide'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 09 02:07:25 user nova-compute[75438]:     </controller>
Nov 09 02:07:25 user nova-compute[75438]:     <interface type='ethernet'>
Nov 09 02:07:25 user nova-compute[75438]:       <mac address='fa:16:3e:b4:98:b3'/>
Nov 09 02:07:25 user nova-compute[75438]:       <target dev='tapc29727fb-92'/>
Nov 09 02:07:25 user nova-compute[75438]:       <model type='virtio'/>
Nov 09 02:07:25 user nova-compute[75438]:       <mtu size='1442'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='net0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </interface>
Nov 09 02:07:25 user nova-compute[75438]:     <serial type='pty'>
Nov 09 02:07:25 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:25 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:25 user nova-compute[75438]:       <target type='isa-serial' port='0'>
Nov 09 02:07:25 user nova-compute[75438]:         <model name='isa-serial'/>
Nov 09 02:07:25 user nova-compute[75438]:       </target>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </serial>
Nov 09 02:07:25 user nova-compute[75438]:     <console type='pty' tty='/dev/pts/8'>
Nov 09 02:07:25 user nova-compute[75438]:       <source path='/dev/pts/8'/>
Nov 09 02:07:25 user nova-compute[75438]:       <log file='/opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac/console.log' append='off'/>
Nov 09 02:07:25 user nova-compute[75438]:       <target type='serial' port='0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='serial0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </console>
Nov 09 02:07:25 user nova-compute[75438]:     <input type='mouse' bus='ps2'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='input0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </input>
Nov 09 02:07:25 user nova-compute[75438]:     <input type='keyboard' bus='ps2'>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='input1'/>
Nov 09 02:07:25 user nova-compute[75438]:     </input>
Nov 09 02:07:25 user nova-compute[75438]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 09 02:07:25 user nova-compute[75438]:       <listen type='address' address='0.0.0.0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </graphics>
Nov 09 02:07:25 user nova-compute[75438]:     <audio id='1' type='none'/>
Nov 09 02:07:25 user nova-compute[75438]:     <video>
Nov 09 02:07:25 user nova-compute[75438]:       <model type='virtio' heads='1' primary='yes'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='video0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </video>
Nov 09 02:07:25 user nova-compute[75438]:     <memballoon model='virtio'>
Nov 09 02:07:25 user nova-compute[75438]:       <stats period='10'/>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='balloon0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:25 user nova-compute[75438]:     <rng model='virtio'>
Nov 09 02:07:25 user nova-compute[75438]:       <backend model='random'>/dev/urandom</backend>
Nov 09 02:07:25 user nova-compute[75438]:       <alias name='rng0'/>
Nov 09 02:07:25 user nova-compute[75438]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 09 02:07:25 user nova-compute[75438]:     </rng>
Nov 09 02:07:25 user nova-compute[75438]:   </devices>
Nov 09 02:07:25 user nova-compute[75438]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 09 02:07:25 user nova-compute[75438]:     <label>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</label>
Nov 09 02:07:25 user nova-compute[75438]:     <imagelabel>libvirt-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac</imagelabel>
Nov 09 02:07:25 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:25 user nova-compute[75438]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 09 02:07:25 user nova-compute[75438]:     <label>+64055:+108</label>
Nov 09 02:07:25 user nova-compute[75438]:     <imagelabel>+64055:+108</imagelabel>
Nov 09 02:07:25 user nova-compute[75438]:   </seclabel>
Nov 09 02:07:25 user nova-compute[75438]: </domain>
Nov 09 02:07:25 user nova-compute[75438]:  {{(pid=75438) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 09 02:07:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Detaching interface fa:16:3e:7a:ef:90 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap350cbba2-4b' not found.
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Converting VIF {"id": "350cbba2-4bc6-4b04-9d14-ad385469f945", "address": "fa:16:3e:7a:ef:90", "network": {"id": "16feeeb0-e4cc-45ad-afb1-779dd3247d25", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-254524457", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350cbba2-4b", "ovs_interfaceid": "350cbba2-4bc6-4b04-9d14-ad385469f945", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_vif [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb05429d-bd35-4b02-b7ed-024d6d6d1f0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24583be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f'): ({'sde'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Removing single pathed devices sde {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350cbba2-4b, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fa8c648-58, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fa8c648-58, col_values=(('qos', UUID('51b3650a-935e-4e5c-89da-ac5c81f182a4')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fa8c648-58, col_values=(('external_ids', {'iface-id': '7fa8c648-589d-4f5e-9eae-e2e01afd3ad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:fe:45', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: INFO os_vif [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ef:90,bridge_name='br-int',has_traffic_filtering=True,id=350cbba2-4bc6-4b04-9d14-ad385469f945,network=Network(16feeeb0-e4cc-45ad-afb1-779dd3247d25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350cbba2-4b')
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [req-786f56fe-8d2d-4bb2-8bd8-8fbeba56b1c6 req-9e79f33c-fbf5-4e74-94b5-c12dfa8fbc13 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:25 user nova-compute[75438]:   <nova:package version="0.0.0"/>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:name>tempest-device-tagging-server-2030865017</nova:name>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:creationTime>2023-11-09 02:07:25</nova:creationTime>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:flavor name="m1.tiny">
Nov 09 02:07:25 user nova-compute[75438]:     <nova:memory>512</nova:memory>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:disk>1</nova:disk>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:swap>0</nova:swap>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:flavor>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:owner>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:user uuid="465ad518561a4635835ffe05296b0d6e">tempest-TaggedAttachmentsTest-300578962-project-member</nova:user>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:project uuid="d6c16810f93a475abcee4b697a8019bc">tempest-TaggedAttachmentsTest-300578962</nova:project>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:owner>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:25 user nova-compute[75438]:   <nova:ports>
Nov 09 02:07:25 user nova-compute[75438]:     <nova:port uuid="c29727fb-924a-4912-a60e-c6af7386834e">
Nov 09 02:07:25 user nova-compute[75438]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:07:25 user nova-compute[75438]:     </nova:port>
Nov 09 02:07:25 user nova-compute[75438]:   </nova:ports>
Nov 09 02:07:25 user nova-compute[75438]: </nova:instance>
Nov 09 02:07:25 user nova-compute[75438]:  {{(pid=75438) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c3a33b-9f1d-45c3-9044-a3fd00bb1468]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebe939-d964-428b-a473-5cd9ae9ac050]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Flushing IO for device /dev/sde {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58')
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f6013e-01e5-4b75-bcc7-547db5411c9f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f8edc1e-07ef-5fcf-8e96-f2bd947534de', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3272a85-7390-491e-9745-938cabc083a0]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5e26b9-05d9-4cc0-a68c-86ce15c54230]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f479e5a-1a, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f479e5a-1a, col_values=(('qos', UUID('df8c417d-3ace-4196-9232-c0e85cbe7d06')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f479e5a-1a, col_values=(('external_ids', {'iface-id': '9f479e5a-1ae3-432b-9d14-a51ea1e13e42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:52:05', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a')
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c39049d-0007-55a1-99f7-4d11245ce9cb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.111s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb074e-59a1-4ed4-890c-682f6156700b]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-e846ac87-303b-4946-a362-eb8f55316585 req-9206b6f5-ceaa-4082-b213-e96cd60c40f8 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-vif-deleted-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:25 user nova-compute[75438]: INFO nova.compute.manager [req-e846ac87-303b-4946-a362-eb8f55316585 req-9206b6f5-ceaa-4082-b213-e96cd60c40f8 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Neutron deleted interface 0ad4d0bd-1c1b-43cf-800e-c62858fa97b9; detaching it from the instance and deleting it from the info cache
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-e846ac87-303b-4946-a362-eb8f55316585 req-9206b6f5-ceaa-4082-b213-e96cd60c40f8 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:25 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Took 0.95 seconds to deallocate network for instance.
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260]
Nov 09 02:07:25 user nova-compute[75438]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-e846ac87-303b-4946-a362-eb8f55316585 req-9206b6f5-ceaa-4082-b213-e96cd60c40f8 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Detach interface failed, port_id=0ad4d0bd-1c1b-43cf-800e-c62858fa97b9, reason: Instance ad38be13-18b6-4de6-b28a-fa027946d63c could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.981s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0d1c960-fa39-414a-82da-8d2d2a559c5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[619f298f-b735-43cf-aad4-01665ef1bd93]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.542s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] <== disconnect_volume: return (1013ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.545s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbae05ee5-b5, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbae05ee5-b5, col_values=(('qos', UUID('4c2d453a-8b91-4f02-88a8-2ae1754ab772')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbae05ee5-b5, col_values=(('external_ids', {'iface-id': 'bae05ee5-b5b1-4fa9-aabf-c57fbc020d01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:8e:61', 'vm-uuid': 'b029c08b-ba97-4d48-b734-d8034f7a4cdf'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-b5d183f8-5662-4d86-931b-5133871cf9fd req-464a23e3-dbe4-4548-9093-d89071ef9263 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received event network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b5d183f8-5662-4d86-931b-5133871cf9fd req-464a23e3-dbe4-4548-9093-d89071ef9263 service nova] Acquiring lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b5d183f8-5662-4d86-931b-5133871cf9fd req-464a23e3-dbe4-4548-9093-d89071ef9263 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b5d183f8-5662-4d86-931b-5133871cf9fd req-464a23e3-dbe4-4548-9093-d89071ef9263 service nova] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-b5d183f8-5662-4d86-931b-5133871cf9fd req-464a23e3-dbe4-4548-9093-d89071ef9263 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] No waiting events found dispatching network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:25 user nova-compute[75438]: WARNING nova.compute.manager [req-b5d183f8-5662-4d86-931b-5133871cf9fd req-464a23e3-dbe4-4548-9093-d89071ef9263 service nova] [instance: ad38be13-18b6-4de6-b28a-fa027946d63c] Received unexpected event network-vif-plugged-0ad4d0bd-1c1b-43cf-800e-c62858fa97b9 for instance with vm_state active and task_state deleting.
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ed735b-cd0f-4954-b94b-cd3e22707257]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:07:25 user nova-compute[75438]: No targets found.
Nov 09 02:07:25 user nova-compute[75438]: iSNS:
Nov 09 02:07:25 user nova-compute[75438]: No targets found.
Nov 09 02:07:25 user nova-compute[75438]: STATIC:
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:07:25 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:07:25 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:07:25 user nova-compute[75438]: FIRMWARE:
Nov 09 02:07:25 user nova-compute[75438]: No targets found.
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:07:25 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:07:25 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b91125-d039-47c1-a568-0ed155114601]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [{"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:25 user nova-compute[75438]: INFO os_vif [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5')
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.062s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd602a5-8ab1-49c0-94ec-a49aa0a869cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:25 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba244c9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653'): ({'sdi'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Removing single pathed devices sdi {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Releasing lock "refresh_cache-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e62628-ce4e-4891-8cb4-0b202b946c05]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a97e472-7296-413e-981b-773d30b1981c tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "interface-0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-350cbba2-4bc6-4b04-9d14-ad385469f945" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.385s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8019c-5220-4114-a41a-5a305986c2ac]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Flushing IO for device /dev/sdi {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] No BDM found with device name hda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] No VIF found with MAC fa:16:3e:10:df:7c, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] No VIF found with MAC fa:16:3e:52:fe:45, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:07:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Using config drive
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b70419-8d9b-47af-9a84-906396700af2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:07:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7710b429-f8c4-4b94-9fd6-7c97a0cffcfb]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] SCSI volumes sdi have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1710d5-1ea1-4470-aeca-df189c546a79]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed920f95-013e-448d-a8c7-9685b3dbf7c3]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260]
Nov 09 02:07:26 user nova-compute[75438]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:826b6b7b-447d-4787-9c34-fbafad5fc653 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af71880-1516-49bf-ad70-9141db9cf3ef]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] <== disconnect_volume: return (1004ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:07:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Creating config drive at /opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf/disk.config
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpolclbjzf {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] swap_volume: Updating volume f85746e7-c2e7-4e22-84a9-09c692f13714 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WNUeiPEj", "auth_password": "nqRfVYkm6DHBU7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1"}, "status": "reserved", "instance": "58220e40-bfca-4be5-a3af-d1011f77e1a8", "attached_at": "", "detached_at": "", "volume_id": "3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1", "serial": "3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'no_device': None, 'attachment_id': '1470a955-9699-4d35-b032-084ba29883ce'} {{(pid=75438) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpolclbjzf" returned: 0 in 0.080s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f09459d-86ee-4619-8b8c-5b5186ed7091 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 54.023s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.709s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:26 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Deleted allocations for instance ad38be13-18b6-4de6-b28a-fa027946d63c
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-647e97ee-7aec-42c9-b43e-d313d7cd4332 tempest-VolumesActionsTest-721255364 tempest-VolumesActionsTest-721255364-project-member] Lock "ad38be13-18b6-4de6-b28a-fa027946d63c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.877s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lazy-loading 'flavor' on Instance uuid 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bddc3bbf-66d9-4b13-8181-62609053d9d4 tempest-VolumesAssistedSnapshotsTest-1662649339 tempest-VolumesAssistedSnapshotsTest-1662649339-project-admin] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.719s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance destroyed successfully.
Nov 09 02:07:27 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Attempting rescue
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75438) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:07:27 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Creating image(s)
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lazy-loading 'flavor' on Instance uuid 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:27 user nova-compute[75438]: WARNING nova.compute.manager [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state active and task_state rescuing.
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:27 user nova-compute[75438]: WARNING nova.compute.manager [req-0dad58d1-e805-4c67-bc3a-565cd8f0757f req-271fddc5-3730-4d43-863e-121a333d0982 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state active and task_state rescuing.
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue" returned: 0 in 0.083s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'migration_context' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-831fa072-4034-405b-ae51-f95c6e400a39 tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.456s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.base [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<3be630c7-6913-421f-aa2e-19f3208b12e7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Start _get_guest_xml network_info=[{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:f5:b2:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'resources' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.base [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<3be630c7-6913-421f-aa2e-19f3208b12e7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:07:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'numa_topology' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.objects.base [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<3be630c7-6913-421f-aa2e-19f3208b12e7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:07:28 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:28 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.objects.base [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<3be630c7-6913-421f-aa2e-19f3208b12e7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1073959700',display_name='tempest-ServerRescueNegativeTestJSON-server-1073959700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1073959700',id=2,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-7fepwe91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:02:45Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=3be630c7-6913-421f-aa2e-19f3208b12e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:f5:b2:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:f5:b2:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'pci_devices' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.objects.base [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<3be630c7-6913-421f-aa2e-19f3208b12e7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:07:28 user nova-compute[75438]:   <uuid>3be630c7-6913-421f-aa2e-19f3208b12e7</uuid>
Nov 09 02:07:28 user nova-compute[75438]:   <name>instance-00000002</name>
Nov 09 02:07:28 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:07:28 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:07:28 user nova-compute[75438]:   <metadata>
Nov 09 02:07:28 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:28 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:07:28 user nova-compute[75438]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1073959700</nova:name>
Nov 09 02:07:28 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:07:28</nova:creationTime>
Nov 09 02:07:28 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:07:28 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:28 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:07:28 user nova-compute[75438]:       <nova:owner>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:user uuid="ab1818da0f7a44fe8ae3f9ffce360386">tempest-ServerRescueNegativeTestJSON-655487496-project-member</nova:user>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:project uuid="92bdfa4af42b4c9796dd143f0c4c3da1">tempest-ServerRescueNegativeTestJSON-655487496</nova:project>
Nov 09 02:07:28 user nova-compute[75438]:       </nova:owner>
Nov 09 02:07:28 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:28 user nova-compute[75438]:       <nova:ports>
Nov 09 02:07:28 user nova-compute[75438]:         <nova:port uuid="451325f5-662e-4cc1-893f-f44ae03ac241">
Nov 09 02:07:28 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 02:07:28 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:28 user nova-compute[75438]:       </nova:ports>
Nov 09 02:07:28 user nova-compute[75438]:     </nova:instance>
Nov 09 02:07:28 user nova-compute[75438]:   </metadata>
Nov 09 02:07:28 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:07:28 user nova-compute[75438]:     <system>
Nov 09 02:07:28 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:07:28 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:07:28 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:07:28 user nova-compute[75438]:       <entry name="serial">3be630c7-6913-421f-aa2e-19f3208b12e7</entry>
Nov 09 02:07:28 user nova-compute[75438]:       <entry name="uuid">3be630c7-6913-421f-aa2e-19f3208b12e7</entry>
Nov 09 02:07:28 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:07:28 user nova-compute[75438]:     </system>
Nov 09 02:07:28 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:28 user nova-compute[75438]:   <os>
Nov 09 02:07:28 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:07:28 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:07:28 user nova-compute[75438]:   </os>
Nov 09 02:07:28 user nova-compute[75438]:   <features>
Nov 09 02:07:28 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:28 user nova-compute[75438]:     <apic/>
Nov 09 02:07:28 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:07:28 user nova-compute[75438]:   </features>
Nov 09 02:07:28 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:07:28 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:07:28 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:07:28 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:07:28 user nova-compute[75438]:   </clock>
Nov 09 02:07:28 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:07:28 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:07:28 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:07:28 user nova-compute[75438]:   </cpu>
Nov 09 02:07:28 user nova-compute[75438]:   <devices>
Nov 09 02:07:28 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:07:28 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:07:28 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue"/>
Nov 09 02:07:28 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:07:28 user nova-compute[75438]:     </disk>
Nov 09 02:07:28 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:07:28 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:07:28 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk"/>
Nov 09 02:07:28 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:07:28 user nova-compute[75438]:     </disk>
Nov 09 02:07:28 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:28 user nova-compute[75438]:       <mac address="fa:16:3e:f5:b2:ec"/>
Nov 09 02:07:28 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:28 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:28 user nova-compute[75438]:       <target dev="tap451325f5-66"/>
Nov 09 02:07:28 user nova-compute[75438]:     </interface>
Nov 09 02:07:28 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:07:28 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/console.log" append="off"/>
Nov 09 02:07:28 user nova-compute[75438]:     </serial>
Nov 09 02:07:28 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:07:28 user nova-compute[75438]:     <video>
Nov 09 02:07:28 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:28 user nova-compute[75438]:     </video>
Nov 09 02:07:28 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:07:28 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:07:28 user nova-compute[75438]:     </rng>
Nov 09 02:07:28 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:07:28 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:07:28 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:07:28 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:28 user nova-compute[75438]:   </devices>
Nov 09 02:07:28 user nova-compute[75438]: </domain>
Nov 09 02:07:28 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:07:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance destroyed successfully.
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:f5:b2:ec, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG os_brick.utils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2c84d0-3871-4baf-963a-d3a54ee55e7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc3fe63-50b9-4001-bffd-f66b1083ba8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c71e682-a430-427d-8d28-f86fea79edf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[679a8f35-31c2-4f5b-b4dc-b0aefeccd502]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:07:28 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[951b0bb4-bcb9-46f3-9e83-d405ade09ba2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG os_brick.utils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:28 user nova-compute[75438]: INFO nova.compute.manager [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Swapping volume 3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 for f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:28 user nova-compute[75438]: INFO nova.compute.manager [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Terminating instance
Nov 09 02:07:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c093035-357d-4d27-804f-f114456d0c44 req-dad43c5b-04f8-4b00-bb52-cc6af86daefe service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-vif-unplugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8c093035-357d-4d27-804f-f114456d0c44 req-dad43c5b-04f8-4b00-bb52-cc6af86daefe service nova] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8c093035-357d-4d27-804f-f114456d0c44 req-dad43c5b-04f8-4b00-bb52-cc6af86daefe service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8c093035-357d-4d27-804f-f114456d0c44 req-dad43c5b-04f8-4b00-bb52-cc6af86daefe service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c093035-357d-4d27-804f-f114456d0c44 req-dad43c5b-04f8-4b00-bb52-cc6af86daefe service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] No waiting events found dispatching network-vif-unplugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c093035-357d-4d27-804f-f114456d0c44 req-dad43c5b-04f8-4b00-bb52-cc6af86daefe service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-vif-unplugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:29 user nova-compute[75438]: WARNING nova.compute.manager [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 for instance with vm_state building and task_state spawning.
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:29 user nova-compute[75438]: WARNING nova.compute.manager [req-b6b9c17e-0ded-463f-b36f-a473d1d14246 req-66a58c57-3331-4860-a26d-99108eb25d37 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 for instance with vm_state building and task_state spawning.
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Instance destroyed successfully.
Nov 09 02:07:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lazy-loading 'resources' on Instance uuid 5148fd3c-cf19-4108-bcf2-7ef96368cbc5 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:02:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-798063300',display_name='tempest-AttachSCSIVolumeTestJSON-server-798063300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-798063300',id=6,image_ref='b575526e-a3f5-4629-992e-8e7eb36cc116',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs/orgcrP+ZrNok4mnlONEq2NUGZwZm3v/MLXn12w+LrMtFtove00vqXVrRXsoDr3RJ6S28D5EOY9ivZZX8ZMxBsZEXi1AgCUwxvyrZT4E6H0kyWdtG45VfZA1T1A8ALQ==',key_name='tempest-keypair-1488121515',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b418d1a5990241ad943b90cb6c306f6e',ramdisk_id='',reservation_id='r-7ushs25u',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b575526e-a3f5-4629-992e-8e7eb36cc116',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-741934769',owner_user_name='tempest-AttachSCSIVolumeTestJSON-741934769-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9741464b46944a68b510022a306637e8',uuid=5148fd3c-cf19-4108-bcf2-7ef96368cbc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Converting VIF {"id": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "address": "fa:16:3e:4e:e9:01", "network": {"id": "a20f1a97-ba7b-41de-b852-db067dad7dc8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-433947468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b418d1a5990241ad943b90cb6c306f6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedbd4134-fb", "ovs_interfaceid": "edbd4134-fb45-4bf8-9b11-b1a854c81151", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG os_vif [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedbd4134-fb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=932d7af4-b26b-41a6-bf9e-970d9a61468f) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: INFO os_vif [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=edbd4134-fb45-4bf8-9b11-b1a854c81151,network=Network(a20f1a97-ba7b-41de-b852-db067dad7dc8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedbd4134-fb')
Nov 09 02:07:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Deleting instance files /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5_del
Nov 09 02:07:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Deletion of /opt/stack/data/nova/instances/5148fd3c-cf19-4108-bcf2-7ef96368cbc5_del complete
Nov 09 02:07:30 user nova-compute[75438]: INFO nova.compute.manager [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Took 1.98 seconds to destroy the instance on the hypervisor.
Nov 09 02:07:30 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Acquiring lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] No waiting events found dispatching network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:31 user nova-compute[75438]: WARNING nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received unexpected event network-vif-plugged-edbd4134-fb45-4bf8-9b11-b1a854c81151 for instance with vm_state active and task_state deleting.
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:31 user nova-compute[75438]: WARNING nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 for instance with vm_state building and task_state spawning.
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:31 user nova-compute[75438]: WARNING nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 for instance with vm_state building and task_state spawning.
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:31 user nova-compute[75438]: WARNING nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b for instance with vm_state building and task_state spawning.
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:31 user nova-compute[75438]: WARNING nova.compute.manager [req-284ca234-6a98-4200-9f7b-2dd6776b9d28 req-aac68801-2425-4767-b178-499af0eab278 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b for instance with vm_state building and task_state spawning.
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:31 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Took 0.97 seconds to deallocate network for instance.
Nov 09 02:07:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-8099a3ba-4fc2-4060-af93-8540525ca3bc req-b763a2a6-c12f-4e45-abd7-4b277d068627 service nova] [instance: 5148fd3c-cf19-4108-bcf2-7ef96368cbc5] Received event network-vif-deleted-edbd4134-fb45-4bf8-9b11-b1a854c81151 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:32 user nova-compute[75438]: WARNING nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e for instance with vm_state building and task_state spawning.
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:32 user nova-compute[75438]: WARNING nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e for instance with vm_state building and task_state spawning.
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:32 user nova-compute[75438]: WARNING nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 for instance with vm_state building and task_state spawning.
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:32 user nova-compute[75438]: WARNING nova.compute.manager [req-4f9ae7c9-0b67-4ad5-a0b7-2e1e59f59258 req-e8babd73-3cb1-45a6-acc4-ea3db174ee89 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 for instance with vm_state building and task_state spawning.
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Deleted allocations for instance 5148fd3c-cf19-4108-bcf2-7ef96368cbc5
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b70062df-1ab1-4603-8262-ee138e428e2f tempest-AttachSCSIVolumeTestJSON-741934769 tempest-AttachSCSIVolumeTestJSON-741934769-project-member] Lock "5148fd3c-cf19-4108-bcf2-7ef96368cbc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.819s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:33 user nova-compute[75438]: WARNING nova.compute.manager [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 for instance with vm_state building and task_state spawning.
Nov 09 02:07:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:33 user nova-compute[75438]: WARNING nova.compute.manager [req-eddcb59b-e44d-457e-badd-92c9bc5ef59f req-7da6b8e6-7734-49cc-bbfb-fe3c55f30eb2 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 for instance with vm_state building and task_state spawning.
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:34 user nova-compute[75438]: WARNING nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 for instance with vm_state building and task_state spawning.
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:34 user nova-compute[75438]: WARNING nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 for instance with vm_state building and task_state spawning.
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:34 user nova-compute[75438]: WARNING nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state active and task_state rescuing.
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:34 user nova-compute[75438]: WARNING nova.compute.manager [req-88656db3-fead-4f66-a78a-bee847590f74 req-290be268-c024-4cb9-802d-4bbf3ac367aa service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state active and task_state rescuing.
Nov 09 02:07:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5cf5fd34-2db8-4fb0-bc32-be9b84149213 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:07:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance spawned successfully.
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:07:35 user nova-compute[75438]: INFO nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Took 17.86 seconds to spawn the instance on the hypervisor.
Nov 09 02:07:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:07:35 user nova-compute[75438]: INFO nova.compute.manager [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Took 199.89 seconds to build instance.
Nov 09 02:07:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc11c840-3bd5-4040-a553-c129242ca019 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 199.986s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:07:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:07:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:07:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Starting finish_migration {{(pid=75438) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 09 02:07:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:07:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Creating image(s)
Nov 09 02:07:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:44 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk. size=21474836480 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:07:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk 21474836480 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk 21474836480" returned: 0 in 0.052s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Ensure instance console log exists: /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start _get_guest_xml network_info=[{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '09c4a0c9-a755-4bb7-ba6d-357e9363d140', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '05bf2ae1-5578-4573-b0c7-9ce14999da93', 'attached_at': '2023-11-09T02:07:44.000000', 'detached_at': '', 'volume_id': '12d5308d-cae3-4796-b701-cd59e18bf553', 'serial': '12d5308d-cae3-4796-b701-cd59e18bf553'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:07:45 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:45 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:07:45 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:45 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:07:45 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9607d9f7-d326-41a3-9ca7-2ce88ddf9757]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:07:45 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab37e1-9d12-4fb0-b901-fdb7ec45740b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553] added
Nov 09 02:07:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fc0f6a-d9ad-4a47-bdb0-b39b1e1a4c64]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63c0df-b517-49d5-b7ea-7f2e407cdf4b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMokQxc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMokQxc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bd6c2a-0b4f-48f5-9d46-687a44b918d1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvMokQxc'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e4d99-add1-441b-b414-fcf4cdd5fea3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b645f824-f0d9-4d47-a36a-14cda8c3c343]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7388c7-ccc5-422a-9b19-7fd06376c4f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]
Nov 09 02:07:45 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.
Nov 09 02:07:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8d5a6-043a-4e79-8eb3-4cd786db5d8e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c91ef70-0e8e-4e4a-b67b-b04e4cd5553b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:07:45 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:07:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f6c8e-4c34-4da6-a400-f0fcfc241e73]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23230623734613064', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623734613064', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:07:46 user nova-compute[75438]:   <uuid>05bf2ae1-5578-4573-b0c7-9ce14999da93</uuid>
Nov 09 02:07:46 user nova-compute[75438]:   <name>instance-00000003</name>
Nov 09 02:07:46 user nova-compute[75438]:   <memory>2097152</memory>
Nov 09 02:07:46 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:07:46 user nova-compute[75438]:   <metadata>
Nov 09 02:07:46 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:07:46 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:07:46 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherB-server-900109230</nova:name>
Nov 09 02:07:46 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:07:45</nova:creationTime>
Nov 09 02:07:46 user nova-compute[75438]:       <nova:flavor name="m1.small">
Nov 09 02:07:46 user nova-compute[75438]:         <nova:memory>2048</nova:memory>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:disk>20</nova:disk>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:07:46 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:07:46 user nova-compute[75438]:       <nova:owner>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:user uuid="be52867f38a447129d9960106a2525f7">tempest-ServerActionsTestOtherB-1383355237-project-member</nova:user>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:project uuid="a20628afe4aa4c0aae9c883d4531cc74">tempest-ServerActionsTestOtherB-1383355237</nova:project>
Nov 09 02:07:46 user nova-compute[75438]:       </nova:owner>
Nov 09 02:07:46 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:07:46 user nova-compute[75438]:       <nova:ports>
Nov 09 02:07:46 user nova-compute[75438]:         <nova:port uuid="9c8b67f2-a61a-4580-85c9-ee3583275dc7">
Nov 09 02:07:46 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:07:46 user nova-compute[75438]:         </nova:port>
Nov 09 02:07:46 user nova-compute[75438]:       </nova:ports>
Nov 09 02:07:46 user nova-compute[75438]:     </nova:instance>
Nov 09 02:07:46 user nova-compute[75438]:   </metadata>
Nov 09 02:07:46 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:07:46 user nova-compute[75438]:     <system>
Nov 09 02:07:46 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:07:46 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:07:46 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:07:46 user nova-compute[75438]:       <entry name="serial">05bf2ae1-5578-4573-b0c7-9ce14999da93</entry>
Nov 09 02:07:46 user nova-compute[75438]:       <entry name="uuid">05bf2ae1-5578-4573-b0c7-9ce14999da93</entry>
Nov 09 02:07:46 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:07:46 user nova-compute[75438]:     </system>
Nov 09 02:07:46 user nova-compute[75438]:   </sysinfo>
Nov 09 02:07:46 user nova-compute[75438]:   <os>
Nov 09 02:07:46 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:07:46 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:07:46 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:07:46 user nova-compute[75438]:   </os>
Nov 09 02:07:46 user nova-compute[75438]:   <features>
Nov 09 02:07:46 user nova-compute[75438]:     <acpi/>
Nov 09 02:07:46 user nova-compute[75438]:     <apic/>
Nov 09 02:07:46 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:07:46 user nova-compute[75438]:   </features>
Nov 09 02:07:46 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:07:46 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:07:46 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:07:46 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:07:46 user nova-compute[75438]:   </clock>
Nov 09 02:07:46 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:07:46 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:07:46 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:07:46 user nova-compute[75438]:   </cpu>
Nov 09 02:07:46 user nova-compute[75438]:   <devices>
Nov 09 02:07:46 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:07:46 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:07:46 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk"/>
Nov 09 02:07:46 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:07:46 user nova-compute[75438]:     </disk>
Nov 09 02:07:46 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:07:46 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:07:46 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:07:46 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:07:46 user nova-compute[75438]:       <serial>12d5308d-cae3-4796-b701-cd59e18bf553</serial>
Nov 09 02:07:46 user nova-compute[75438]:     </disk>
Nov 09 02:07:46 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:07:46 user nova-compute[75438]:       <mac address="fa:16:3e:87:5b:eb"/>
Nov 09 02:07:46 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:46 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:07:46 user nova-compute[75438]:       <target dev="tap9c8b67f2-a6"/>
Nov 09 02:07:46 user nova-compute[75438]:     </interface>
Nov 09 02:07:46 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:07:46 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/console.log" append="off"/>
Nov 09 02:07:46 user nova-compute[75438]:     </serial>
Nov 09 02:07:46 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:07:46 user nova-compute[75438]:     <video>
Nov 09 02:07:46 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:07:46 user nova-compute[75438]:     </video>
Nov 09 02:07:46 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:07:46 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:07:46 user nova-compute[75438]:     </rng>
Nov 09 02:07:46 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:07:46 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:07:46 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:07:46 user nova-compute[75438]:     </memballoon>
Nov 09 02:07:46 user nova-compute[75438]:   </devices>
Nov 09 02:07:46 user nova-compute[75438]: </domain>
Nov 09 02:07:46 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-971753495-network", "vif_mac": "fa:16:3e:87:5b:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG os_vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb851f68-c451-5f30-a0fd-4dee31133f26', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8b67f2-a6, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c8b67f2-a6, col_values=(('qos', UUID('87a7e2a3-7c6c-44bd-a1f3-d3e5c4317714')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c8b67f2-a6, col_values=(('external_ids', {'iface-id': '9c8b67f2-a61a-4580-85c9-ee3583275dc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5b:eb', 'vm-uuid': '05bf2ae1-5578-4573-b0c7-9ce14999da93'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:46 user nova-compute[75438]: INFO os_vif [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6')
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:07:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] No VIF found with MAC fa:16:3e:87:5b:eb, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:07:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-07d93a81-04cd-4204-acea-5a89d849123e req-f22f0a3d-40c7-49c6-b7a2-1e59a27cc0bf service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-07d93a81-04cd-4204-acea-5a89d849123e req-f22f0a3d-40c7-49c6-b7a2-1e59a27cc0bf service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-07d93a81-04cd-4204-acea-5a89d849123e req-f22f0a3d-40c7-49c6-b7a2-1e59a27cc0bf service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-07d93a81-04cd-4204-acea-5a89d849123e req-f22f0a3d-40c7-49c6-b7a2-1e59a27cc0bf service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-07d93a81-04cd-4204-acea-5a89d849123e req-f22f0a3d-40c7-49c6-b7a2-1e59a27cc0bf service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:49 user nova-compute[75438]: WARNING nova.compute.manager [req-07d93a81-04cd-4204-acea-5a89d849123e req-f22f0a3d-40c7-49c6-b7a2-1e59a27cc0bf service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state active and task_state resize_finish.
Nov 09 02:07:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:07:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance running successfully.
Nov 09 02:07:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Failed to set time: agent not configured {{(pid=75438) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-fe78ff70-17ff-4d97-bb7a-83924f76c04e tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] finish_migration finished successfully. {{(pid=75438) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-567a6309-f9e5-422b-8ac8-0bf83edf2af3 req-e2d6bf1f-424f-4cf0-8363-0da8a5f5dbe7 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-567a6309-f9e5-422b-8ac8-0bf83edf2af3 req-e2d6bf1f-424f-4cf0-8363-0da8a5f5dbe7 service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-567a6309-f9e5-422b-8ac8-0bf83edf2af3 req-e2d6bf1f-424f-4cf0-8363-0da8a5f5dbe7 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-567a6309-f9e5-422b-8ac8-0bf83edf2af3 req-e2d6bf1f-424f-4cf0-8363-0da8a5f5dbe7 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-567a6309-f9e5-422b-8ac8-0bf83edf2af3 req-e2d6bf1f-424f-4cf0-8363-0da8a5f5dbe7 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:51 user nova-compute[75438]: WARNING nova.compute.manager [req-567a6309-f9e5-422b-8ac8-0bf83edf2af3 req-e2d6bf1f-424f-4cf0-8363-0da8a5f5dbe7 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state resized and task_state None.
Nov 09 02:07:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:54 user nova-compute[75438]: INFO nova.compute.manager [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Terminating instance
Nov 09 02:07:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-ec489cdd-d245-4029-9674-bca6a1e65bfb req-0f56e610-5280-4e79-8ff6-b7b7d7ca8430 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-unplugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ec489cdd-d245-4029-9674-bca6a1e65bfb req-0f56e610-5280-4e79-8ff6-b7b7d7ca8430 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ec489cdd-d245-4029-9674-bca6a1e65bfb req-0f56e610-5280-4e79-8ff6-b7b7d7ca8430 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ec489cdd-d245-4029-9674-bca6a1e65bfb req-0f56e610-5280-4e79-8ff6-b7b7d7ca8430 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-ec489cdd-d245-4029-9674-bca6a1e65bfb req-0f56e610-5280-4e79-8ff6-b7b7d7ca8430 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-unplugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-ec489cdd-d245-4029-9674-bca6a1e65bfb req-0f56e610-5280-4e79-8ff6-b7b7d7ca8430 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-unplugged-c29727fb-924a-4912-a60e-c6af7386834e for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:07:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Instance destroyed successfully.
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.objects.instance [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lazy-loading 'resources' on Instance uuid 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2030865017',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2030865017',id=8,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXzTbmpIEbKl61aT4INsNlxzh34K+EZ0mCdq00TpsRZug2v5+7hi+ZaLZuwdd1Do4eHcAaNw//MCJ6VJJTl17mQacTCnHIJbq3ZWGUSw2xMg7ixhJo3b+A7eGRV9kOswA==',key_name='tempest-keypair-1101346448',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c16810f93a475abcee4b697a8019bc',ramdisk_id='',reservation_id='r-b00gmmin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-300578962',owner_user_name='tempest-TaggedAttachmentsTest-300578962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='465ad518561a4635835ffe05296b0d6e',uuid=0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converting VIF {"id": "c29727fb-924a-4912-a60e-c6af7386834e", "address": "fa:16:3e:b4:98:b3", "network": {"id": "c1cef07f-3ed4-4d54-8386-b1c0cd4f662e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2070491014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c16810f93a475abcee4b697a8019bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc29727fb-92", "ovs_interfaceid": "c29727fb-924a-4912-a60e-c6af7386834e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG os_vif [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc29727fb-92, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e93f689d-4ea1-4166-a32a-895a5125c722) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:07:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:07:55 user nova-compute[75438]: INFO os_vif [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:98:b3,bridge_name='br-int',has_traffic_filtering=True,id=c29727fb-924a-4912-a60e-c6af7386834e,network=Network(c1cef07f-3ed4-4d54-8386-b1c0cd4f662e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc29727fb-92')
Nov 09 02:07:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Deleting instance files /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac_del
Nov 09 02:07:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Deletion of /opt/stack/data/nova/instances/0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac_del complete
Nov 09 02:07:56 user nova-compute[75438]: INFO nova.compute.manager [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 09 02:07:56 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:07:56 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:07:56 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:07:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-0e9fb2cf-7bd3-4b78-813a-b5466305fd31 req-8884a1d3-0724-4dcd-94df-73375621aa58 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:07:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0e9fb2cf-7bd3-4b78-813a-b5466305fd31 req-8884a1d3-0724-4dcd-94df-73375621aa58 service nova] Acquiring lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0e9fb2cf-7bd3-4b78-813a-b5466305fd31 req-8884a1d3-0724-4dcd-94df-73375621aa58 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0e9fb2cf-7bd3-4b78-813a-b5466305fd31 req-8884a1d3-0724-4dcd-94df-73375621aa58 service nova] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-0e9fb2cf-7bd3-4b78-813a-b5466305fd31 req-8884a1d3-0724-4dcd-94df-73375621aa58 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] No waiting events found dispatching network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:07:57 user nova-compute[75438]: WARNING nova.compute.manager [req-0e9fb2cf-7bd3-4b78-813a-b5466305fd31 req-8884a1d3-0724-4dcd-94df-73375621aa58 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received unexpected event network-vif-plugged-c29727fb-924a-4912-a60e-c6af7386834e for instance with vm_state active and task_state deleting.
Nov 09 02:07:57 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:07:57 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Took 1.49 seconds to deallocate network for instance.
Nov 09 02:07:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:07:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:07:58 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:07:58 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:07:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:58 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Deleted allocations for instance 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac
Nov 09 02:07:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-440c3924-11eb-4d8b-8704-daba9e6d5d7f tempest-TaggedAttachmentsTest-300578962 tempest-TaggedAttachmentsTest-300578962-project-member] Lock "0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.666s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:07:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-78f65b87-7aa2-412c-978d-e064a3d8c7d0 req-840df9c9-a75c-426d-9ea1-c2c32dbf7118 service nova] [instance: 0df914f3-92d0-45ad-86e3-7a6b6e1ae9ac] Received event network-vif-deleted-c29727fb-924a-4912-a60e-c6af7386834e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58220e40-bfca-4be5-a3af-d1011f77e1a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f85746e7-c2e7-4e22-84a9-09c692f13714', 'serial': 'f85746e7-c2e7-4e22-84a9-09c692f13714'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNUeiPEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1'}, 'status': 'reserved', 'instance': '58220e40-bfca-4be5-a3af-d1011f77e1a8', 'attached_at': '', 'detached_at': '', 'volume_id': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'serial'} {{(pid=75438) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:00 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:00 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:00 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:08:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9c35eb-e718-41d8-a7b8-65b14ef88510]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:08:01 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191ade4-9df0-441b-9d13-2fc793a1a46f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714] added
Nov 09 02:08:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e48360-ae72-47db-ba33-6185b994ab48]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e263431d-f568-4acf-a80b-f0637e575ef2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXscDUJB {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXscDUJB" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e0eac8-42c5-44b3-8ac3-7c1a6972a95b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXscDUJB'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[19561b9a-a9d3-474e-9a49-1d7ff762f79f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d034180f-4f1d-4faa-bb93-52f58c8aeb36]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ed0bb9-2096-4f4d-aa0c-f87a534450dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]
Nov 09 02:08:01 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[10140f00-d73c-4722-aab9-14af7d1a36d3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68c51f2-f984-48dc-ba16-eec42652506a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:01 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a02a6b-f1fa-4d5b-82bd-d6e7c1583edc]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '26564376533376232', 'path': '/dev/sde'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564376533376232', 'path': '/dev/sde'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG nova.objects.instance [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lazy-loading 'flavor' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 91226112 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 211812352 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 367001600 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 522190848 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 664797184 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 797966336 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 1063256064 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'info_cache' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WNUeiPEj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:07 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead33d03-edcd-42e9-a7ae-99669e65376a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:07 user nova-compute[75438]: No targets found.
Nov 09 02:08:07 user nova-compute[75438]: iSNS:
Nov 09 02:08:07 user nova-compute[75438]: No targets found.
Nov 09 02:08:07 user nova-compute[75438]: STATIC:
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:07 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:07 user nova-compute[75438]: No targets found.
Nov 09 02:08:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:07 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:07 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b534d-eb09-4148-bb5b-fb17cc332e12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b17a120-0dbc-4cba-8971-8eaa8313d1c9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:07 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba244ca5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09267a-e021-4eec-9b8b-ad5adad02d51]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ba4666-2328-4e52-bc1e-aa0b20d1a0a3]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6476ff44-6859-4141-8c20-f4b9c371697e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69713bad-1100-4215-a2f9-bb1a585a6b51]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c74b5-1ad1-4fb1-a0f7-de5981975b21]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f829dd1-9469-431a-877f-5715c28d5bbc]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260]
Nov 09 02:08:07 user nova-compute[75438]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b20a3-d00a-4ad9-a520-6fc1ea0aa722]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] <== disconnect_volume: return (398ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance destroyed successfully.
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'resources' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG os_vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71877205-b0, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aca0719f-94ad-43b8-9c6d-410644d54700) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:08 user nova-compute[75438]: INFO os_vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0')
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:08 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '58220e40-bfca-4be5-a3af-d1011f77e1a8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f85746e7-c2e7-4e22-84a9-09c692f13714', 'serial'} {{(pid=75438) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] swap_volume: removing Cinder connection for volume 3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 {{(pid=75438) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf16eb8c-d47d-441a-adcf-62775c1f3ad6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:08 user nova-compute[75438]: No targets found.
Nov 09 02:08:08 user nova-compute[75438]: iSNS:
Nov 09 02:08:08 user nova-compute[75438]: No targets found.
Nov 09 02:08:08 user nova-compute[75438]: STATIC:
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:08 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:08 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:08 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:08 user nova-compute[75438]: No targets found.
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:08 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:08 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f29de-99bd-4d40-a576-3df33a55eadb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[625b3660-3ddd-4faa-aff0-6d417241e781]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba045cbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae2b64-d929-49c2-a44e-9e27391a9f38]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6820de8-c340-43ce-a534-e9a783bcf665]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d0a72-2e17-4b3b-b132-a39a61495b1b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec933f-cc91-41b8-a7ac-c096d3b0477e]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b52866-3926-46bf-b190-42fe7a439c9b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a32e30-3964-4a94-9b85-d062b04d3b8e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]
Nov 09 02:08:08 user nova-compute[75438]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c261667-3776-4568-8f9c-636c1c37cd33]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== disconnect_volume: return (441ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start _get_guest_xml network_info=[{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'e833e7ec-dca8-4308-ac13-b5cffd56cb2c', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a300e943-2854-4f88-97b1-8d2e2b754f12', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'serial': 'ea000b0d-4862-4303-8e98-5e99b87a7bc2'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'numa_topology' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:08 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:08:08 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'vcpu_model' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:08 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:08 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:08 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[939e8b96-031a-4529-8475-bf2a76072094]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:08:08 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506da40-b816-487d-96d9-6b5c940a274b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2] added
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[784cb038-453e-48cb-9430-b912c76bd32a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1128e31c-4cce-4cbf-b691-f8af13a55e73]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQhSrqmJ {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQhSrqmJ" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c613f4-a279-493c-9057-3a37e6e87859]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQhSrqmJ'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6642dd4a-1e38-4190-8702-beff11b1a467]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[322a4fed-65b6-4b1a-a7a4-8cd1857098c1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0882d129-3e38-42c7-a401-739a53eff808]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-changed-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing instance network info cache due to event network-changed-ad8c5704-eb79-468a-98ce-afa53f7a2b90. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] Acquiring lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] Acquired lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG nova.network.neutron [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Refreshing network info cache for port ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]
Nov 09 02:08:08 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab4dc6e-5f13-4693-bdd4-68bdc4b6cbbb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a889b1fc-f51c-4dcd-8b6f-911939df107d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:08 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9787f8b-1c8c-4328-9ac8-0c22f97faf10]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:08:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] swap_volume: Updating volume 3cc4afd2-29b9-4e25-b29d-3e79e4c84ad1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MXscDUJB", "auth_password": "9P5BvlYow46ZSx", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "f85746e7-c2e7-4e22-84a9-09c692f13714"}, "status": "reserved", "instance": "58220e40-bfca-4be5-a3af-d1011f77e1a8", "attached_at": "", "detached_at": "", "volume_id": "f85746e7-c2e7-4e22-84a9-09c692f13714", "serial": "f85746e7-c2e7-4e22-84a9-09c692f13714"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f85746e7-c2e7-4e22-84a9-09c692f13714', 'no_device': None, 'attachment_id': 'e5582ff5-fc99-4d61-992c-fec56471197e'} {{(pid=75438) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9ef1764d-bc96-4220-8b71-b3c8eb058584 tempest-TestVolumeSwap-1688853466 tempest-TestVolumeSwap-1688853466-project-admin] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 40.972s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG nova.network.neutron [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updated VIF entry in instance network info cache for port ad8c5704-eb79-468a-98ce-afa53f7a2b90. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG nova.network.neutron [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f80b2c67-0748-4841-8f2e-bdcf2f21f098 req-e1cc11e6-ed6e-4258-a856-031f2bbe8987 service nova] Releasing lock "refresh_cache-59435d59-9004-4df4-adb7-e88577aa257e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23864353936623637', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864353936623637', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'pci_devices' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:08:10 user nova-compute[75438]:   <uuid>a300e943-2854-4f88-97b1-8d2e2b754f12</uuid>
Nov 09 02:08:10 user nova-compute[75438]:   <name>instance-00000005</name>
Nov 09 02:08:10 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:08:10 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:08:10 user nova-compute[75438]:   <metadata>
Nov 09 02:08:10 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:08:10 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:08:10 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeTestJSON-server-455427829</nova:name>
Nov 09 02:08:10 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:08:08</nova:creationTime>
Nov 09 02:08:10 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:08:10 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:08:10 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:08:10 user nova-compute[75438]:       <nova:owner>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:user uuid="6a26a0160e8042e3a6a83bdb28a41ad0">tempest-AttachVolumeTestJSON-74588244-project-member</nova:user>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:project uuid="be67d22752084a76b41a4e1cff3747cf">tempest-AttachVolumeTestJSON-74588244</nova:project>
Nov 09 02:08:10 user nova-compute[75438]:       </nova:owner>
Nov 09 02:08:10 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:08:10 user nova-compute[75438]:       <nova:ports>
Nov 09 02:08:10 user nova-compute[75438]:         <nova:port uuid="71877205-b0ab-456f-a4e1-9e5f638fb7fc">
Nov 09 02:08:10 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:08:10 user nova-compute[75438]:         </nova:port>
Nov 09 02:08:10 user nova-compute[75438]:       </nova:ports>
Nov 09 02:08:10 user nova-compute[75438]:     </nova:instance>
Nov 09 02:08:10 user nova-compute[75438]:   </metadata>
Nov 09 02:08:10 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:08:10 user nova-compute[75438]:     <system>
Nov 09 02:08:10 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:08:10 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:08:10 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:08:10 user nova-compute[75438]:       <entry name="serial">a300e943-2854-4f88-97b1-8d2e2b754f12</entry>
Nov 09 02:08:10 user nova-compute[75438]:       <entry name="uuid">a300e943-2854-4f88-97b1-8d2e2b754f12</entry>
Nov 09 02:08:10 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:08:10 user nova-compute[75438]:     </system>
Nov 09 02:08:10 user nova-compute[75438]:   </sysinfo>
Nov 09 02:08:10 user nova-compute[75438]:   <os>
Nov 09 02:08:10 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:08:10 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:08:10 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:08:10 user nova-compute[75438]:   </os>
Nov 09 02:08:10 user nova-compute[75438]:   <features>
Nov 09 02:08:10 user nova-compute[75438]:     <acpi/>
Nov 09 02:08:10 user nova-compute[75438]:     <apic/>
Nov 09 02:08:10 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:08:10 user nova-compute[75438]:   </features>
Nov 09 02:08:10 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:08:10 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:08:10 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:08:10 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:08:10 user nova-compute[75438]:   </clock>
Nov 09 02:08:10 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:08:10 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:08:10 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:08:10 user nova-compute[75438]:   </cpu>
Nov 09 02:08:10 user nova-compute[75438]:   <devices>
Nov 09 02:08:10 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:08:10 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:08:10 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk"/>
Nov 09 02:08:10 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:08:10 user nova-compute[75438]:     </disk>
Nov 09 02:08:10 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:08:10 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:08:10 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:08:10 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:08:10 user nova-compute[75438]:       <serial>ea000b0d-4862-4303-8e98-5e99b87a7bc2</serial>
Nov 09 02:08:10 user nova-compute[75438]:     </disk>
Nov 09 02:08:10 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:08:10 user nova-compute[75438]:       <mac address="fa:16:3e:81:73:9c"/>
Nov 09 02:08:10 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:08:10 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:08:10 user nova-compute[75438]:       <target dev="tap71877205-b0"/>
Nov 09 02:08:10 user nova-compute[75438]:     </interface>
Nov 09 02:08:10 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:08:10 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/console.log" append="off"/>
Nov 09 02:08:10 user nova-compute[75438]:     </serial>
Nov 09 02:08:10 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:08:10 user nova-compute[75438]:     <video>
Nov 09 02:08:10 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:08:10 user nova-compute[75438]:     </video>
Nov 09 02:08:10 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:08:10 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:08:10 user nova-compute[75438]:     </rng>
Nov 09 02:08:10 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:08:10 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:08:10 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:08:10 user nova-compute[75438]:     </memballoon>
Nov 09 02:08:10 user nova-compute[75438]:   </devices>
Nov 09 02:08:10 user nova-compute[75438]: </domain>
Nov 09 02:08:10 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:10 user nova-compute[75438]: INFO nova.compute.manager [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Detaching volume f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:10 user nova-compute[75438]: INFO nova.virt.block_device [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Attempting to driver detach volume f85746e7-c2e7-4e22-84a9-09c692f13714 from mountpoint /dev/vdb
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Attempting to detach device vdb from instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:08:10 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:08:10 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:08:10 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:08:10 user nova-compute[75438]:   <serial>f85746e7-c2e7-4e22-84a9-09c692f13714</serial>
Nov 09 02:08:10 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:08:10 user nova-compute[75438]: </disk>
Nov 09 02:08:10 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:08:10 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Successfully detached device vdb from instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 from the persistent domain config.
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:08:10 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:08:10 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:08:10 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:08:10 user nova-compute[75438]:   <serial>f85746e7-c2e7-4e22-84a9-09c692f13714</serial>
Nov 09 02:08:10 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:08:10 user nova-compute[75438]: </disk>
Nov 09 02:08:10 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'trusted_certs' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Cannot resize image /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.objects.instance [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'migration_context' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.objects.base [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG os_vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92bb3039-d6c5-56dc-b4a9-e30ab4f6317c', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71877205-b0, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71877205-b0, col_values=(('qos', UUID('b33dbaf5-6e46-40f0-ba0c-a5bdd2ff3a1f')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71877205-b0, col_values=(('external_ids', {'iface-id': '71877205-b0ab-456f-a4e1-9e5f638fb7fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:73:9c', 'vm-uuid': 'a300e943-2854-4f88-97b1-8d2e2b754f12'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:10 user nova-compute[75438]: INFO os_vif [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0')
Nov 09 02:08:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "59435d59-9004-4df4-adb7-e88577aa257e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:11 user nova-compute[75438]: INFO nova.compute.manager [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Terminating instance
Nov 09 02:08:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa4dd2b8-9f7d-4776-aaac-57ffb427f751 req-ae6d0397-442d-4e5a-ba41-1fc0e96b66cf service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa4dd2b8-9f7d-4776-aaac-57ffb427f751 req-ae6d0397-442d-4e5a-ba41-1fc0e96b66cf service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa4dd2b8-9f7d-4776-aaac-57ffb427f751 req-ae6d0397-442d-4e5a-ba41-1fc0e96b66cf service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa4dd2b8-9f7d-4776-aaac-57ffb427f751 req-ae6d0397-442d-4e5a-ba41-1fc0e96b66cf service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa4dd2b8-9f7d-4776-aaac-57ffb427f751 req-ae6d0397-442d-4e5a-ba41-1fc0e96b66cf service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa4dd2b8-9f7d-4776-aaac-57ffb427f751 req-ae6d0397-442d-4e5a-ba41-1fc0e96b66cf service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-02fddbca-2c66-4c3a-8b17-db0217ac69d4 req-f2830312-00b3-4351-98fb-30d901eb45bb service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-02fddbca-2c66-4c3a-8b17-db0217ac69d4 req-f2830312-00b3-4351-98fb-30d901eb45bb service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-02fddbca-2c66-4c3a-8b17-db0217ac69d4 req-f2830312-00b3-4351-98fb-30d901eb45bb service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-02fddbca-2c66-4c3a-8b17-db0217ac69d4 req-f2830312-00b3-4351-98fb-30d901eb45bb service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-02fddbca-2c66-4c3a-8b17-db0217ac69d4 req-f2830312-00b3-4351-98fb-30d901eb45bb service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-02fddbca-2c66-4c3a-8b17-db0217ac69d4 req-f2830312-00b3-4351-98fb-30d901eb45bb service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-db57c508-885b-469e-bac5-8538d4fb6405 req-9a8b1c5f-e906-4575-8dfc-4e7e0b653251 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-db57c508-885b-469e-bac5-8538d4fb6405 req-9a8b1c5f-e906-4575-8dfc-4e7e0b653251 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-db57c508-885b-469e-bac5-8538d4fb6405 req-9a8b1c5f-e906-4575-8dfc-4e7e0b653251 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-db57c508-885b-469e-bac5-8538d4fb6405 req-9a8b1c5f-e906-4575-8dfc-4e7e0b653251 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-db57c508-885b-469e-bac5-8538d4fb6405 req-9a8b1c5f-e906-4575-8dfc-4e7e0b653251 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-db57c508-885b-469e-bac5-8538d4fb6405 req-9a8b1c5f-e906-4575-8dfc-4e7e0b653251 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-d88f402e-ff60-4542-9d92-683833d89cb9 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:13 user nova-compute[75438]: INFO nova.compute.manager [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Terminating instance
Nov 09 02:08:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:13 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Instance destroyed successfully.
Nov 09 02:08:13 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lazy-loading 'resources' on Instance uuid 02ef8bf0-077e-4653-98f5-9e6fef690fdb {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1401710627',display_name='tempest-VolumesAssistedSnapshotsTest-server-1401710627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1401710627',id=9,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ROf8IxEAI0oKR89B7GVoPqsYxu51FHJSKmtMoi5EMN4gvvsN2GIGZsdd1KdpiNQzmA1NGlBVdGpGNP+iCpZi6j5T2vU+RI48Q14JUxMHJidg+j+z7rgn0bJ9jEKw2YQ==',key_name='tempest-keypair-2135722406',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1d525170e244da985aed014bb19d2dd',ramdisk_id='',reservation_id='r-xsv9pbao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-549865047',owner_user_name='tempest-VolumesAssistedSnapshotsTest-549865047-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fb47b3c0ad040e7ba5a7673a3f7b47e',uuid=02ef8bf0-077e-4653-98f5-9e6fef690fdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Converting VIF {"id": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "address": "fa:16:3e:9e:3d:14", "network": {"id": "d344ee29-0d0c-4f0e-8bcd-a96c436f810e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1337753510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1d525170e244da985aed014bb19d2dd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608d3a29-ea", "ovs_interfaceid": "608d3a29-ea2e-4f08-9a14-334873c6f6d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG os_vif [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap608d3a29-ea, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Instance destroyed successfully.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.objects.instance [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lazy-loading 'resources' on Instance uuid 59435d59-9004-4df4-adb7-e88577aa257e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad8c5704-eb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8c48b02-9be5-4784-b994-e68524c2740e) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-ad8c5704-eb79-468a-98ce-afa53f7a2b90 for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-86e311b5-32c1-41b5-98a8-4aaaac57e470 for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-b8b1235a-e337-42a8-8f96-46c00cd1422c for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-24152b00-4ac8-43f0-ae9b-0d0ac520a772 req-3e8d9c29-eff3-4361-b87c-7d76cc757621 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-b8b1235a-e337-42a8-8f96-46c00cd1422c for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd422472-9544-4c10-9043-eec49008a6d7) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: INFO os_vif [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:3d:14,bridge_name='br-int',has_traffic_filtering=True,id=608d3a29-ea2e-4f08-9a14-334873c6f6d6,network=Network(d344ee29-0d0c-4f0e-8bcd-a96c436f810e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608d3a29-ea')
Nov 09 02:08:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Deleting instance files /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb_del
Nov 09 02:08:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Deletion of /opt/stack/data/nova/instances/02ef8bf0-077e-4653-98f5-9e6fef690fdb_del complete
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-2907c1c0-6a46-4f04-8511-569ba9ba63a7 for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-5b43caae-cb58-41b0-b9ab-169f1ffd5299 for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-unplugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-unplugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-06f2522b-6971-47f1-a645-ff51018fdc10 req-e1fa5d0b-055c-4e99-9468-43ca47e4ad04 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-59faaff1-46be-4ca5-b04f-1ba05fd992fc for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Acquiring lock "59435d59-9004-4df4-adb7-e88577aa257e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Lock "59435d59-9004-4df4-adb7-e88577aa257e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] No waiting events found dispatching network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received unexpected event network-vif-plugged-d88f402e-ff60-4542-9d92-683833d89cb9 for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-vif-unplugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] No waiting events found dispatching network-vif-unplugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-vif-unplugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Acquiring lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] No waiting events found dispatching network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:14 user nova-compute[75438]: WARNING nova.compute.manager [req-0b3adc3f-6e69-4f6a-b908-df052e4b9cea req-9343c842-53e6-492b-b356-f57e965a6557 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received unexpected event network-vif-plugged-608d3a29-ea2e-4f08-9a14-334873c6f6d6 for instance with vm_state active and task_state deleting.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:9b:bc,bridge_name='br-int',has_traffic_filtering=True,id=ad8c5704-eb79-468a-98ce-afa53f7a2b90,network=Network(6309dda9-020a-478c-aa4e-d48780197563),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad8c5704-eb')
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2907c1c0-6a, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: INFO nova.compute.manager [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 09 02:08:14 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a16be90d-695f-466e-a5c9-7624ef2a3dbb) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:7c:12,bridge_name='br-int',has_traffic_filtering=True,id=2907c1c0-6a46-4f04-8511-569ba9ba63a7,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2907c1c0-6a')
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd88f402e-ff, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2086861-3264-4eea-adf4-489521bfd458) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:16:b2,bridge_name='br-int',has_traffic_filtering=True,id=d88f402e-ff60-4542-9d92-683833d89cb9,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd88f402e-ff')
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b43caae-cb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2884033d-711b-4046-95b9-71fe49f0759a) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:1d:f7,bridge_name='br-int',has_traffic_filtering=True,id=5b43caae-cb58-41b0-b9ab-169f1ffd5299,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b43caae-cb')
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86e311b5-32, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b41f173b-d932-4348-887e-aeae895e37fa) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:11:1a,bridge_name='br-int',has_traffic_filtering=True,id=86e311b5-32c1-41b5-98a8-4aaaac57e470,network=Network(c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86e311b5-32')
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59faaff1-46, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=942e73cd-ec2d-4954-bfb2-2407f7b1b694) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f5:af,bridge_name='br-int',has_traffic_filtering=True,id=59faaff1-46be-4ca5-b04f-1ba05fd992fc,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59faaff1-46')
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-134654539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-134654539',id=12,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGH1OXFFB6dQD561QIluMtF33+6EKtNJ1O/J3Fwzb/P4gEiE+SR29mgeCKbAAuHpncQG97/rKc5FSA4Jbe9OKneBps9f/BpQK+AaxoTq0dEmnbtt2O0yEwlGWseha3l1kA==',key_name='tempest-keypair-1144616887',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af8aef490395493a88d8812a79b6f079',ramdisk_id='',reservation_id='r-pqr1sfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-938311404',owner_user_name='tempest-TaggedBootDevicesTest_v242-938311404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4375bc91047e4cdd8e47ce6d293ce3ca',uuid=59435d59-9004-4df4-adb7-e88577aa257e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converting VIF {"id": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "address": "fa:16:3e:05:ba:da", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8b1235a-e3", "ovs_interfaceid": "b8b1235a-e337-42a8-8f96-46c00cd1422c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8b1235a-e3, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e290bd6-c74f-4570-9dd5-609a855a9046) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:15 user nova-compute[75438]: INFO os_vif [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:ba:da,bridge_name='br-int',has_traffic_filtering=True,id=b8b1235a-e337-42a8-8f96-46c00cd1422c,network=Network(73118307-6aa4-4c75-9415-92270845f019),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8b1235a-e3')
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXltKAuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:15 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cdba9f-db11-4091-8865-42cb94f7a52e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:15 user nova-compute[75438]: No targets found.
Nov 09 02:08:15 user nova-compute[75438]: iSNS:
Nov 09 02:08:15 user nova-compute[75438]: No targets found.
Nov 09 02:08:15 user nova-compute[75438]: STATIC:
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:15 user nova-compute[75438]: No targets found.
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:15 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:15 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:08:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance rebooted successfully.
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-61741e06-10bc-4bda-b4ba-f4040c494e45 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5c48fd-de97-4e77-bd6a-e39ef58ecece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[91052ae7-7d99-4086-865c-d257a136b220]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba045cadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059'): ({'sdf'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Removing single pathed devices sdf {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d97171-b756-492e-829c-9acdcf5cf260]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f0b447-8f25-46d1-8ec5-aa4c1676cb83]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Flushing IO for device /dev/sdf {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb0774-d111-4fbc-97b2-b7211e01cca4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ade802-cbe0-4f96-8800-e671ecd54ea9]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] SCSI volumes sdf have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Took 1.00 seconds to deallocate network for instance.
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[19feed65-3afd-467a-9239-f95b23c43090]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a56636-0e22-478b-97ab-d9a1ab422ae1]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260]
Nov 09 02:08:15 user nova-compute[75438]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d2c9c45-5469-4d50-8f4a-e44f38905059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a0065-c521-4753-9ecb-75ee51db2901]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== disconnect_volume: return (421ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAgmrPTS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:15 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ab687d-8824-46b8-adff-6688bdd439df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:15 user nova-compute[75438]: No targets found.
Nov 09 02:08:15 user nova-compute[75438]: iSNS:
Nov 09 02:08:15 user nova-compute[75438]: No targets found.
Nov 09 02:08:15 user nova-compute[75438]: STATIC:
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:15 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:15 user nova-compute[75438]: No targets found.
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:15 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:15 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b120f0f0-fdeb-4e50-a1b4-592e98db656c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[91047617-0864-437c-8794-9046ce15f55d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd (non-flash)
Nov 09 02:08:15 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba045cadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd'): ({'sdg'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Removing single pathed devices sdg {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1898286-6c2b-492e-bf11-a7942ecb9501]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ce622-cb12-4df6-9200-f19ea83b28bd]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Flushing IO for device /dev/sdg {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ed6ab-b470-44b3-b6b0-22a433ccb016]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb6552-c514-42d9-8ba1-b1f69eb57fe6]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] SCSI volumes sdg have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a16fec-a009-470b-ac61-94a4b9d08a26]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:16 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Deleted allocations for instance 02ef8bf0-077e-4653-98f5-9e6fef690fdb
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0126d6b6-12ac-43f1-929c-386b347f3c0c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260]
Nov 09 02:08:16 user nova-compute[75438]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:16 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7838b1b5-648a-460b-bdb2-88c8f09553bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[343a53fc-4919-47e9-ac05-9f3fe3347a3c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== disconnect_volume: return (456ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'brnLiTjA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:16 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7d4b213-ffa0-4285-84e0-7b7261a79173 tempest-VolumesAssistedSnapshotsTest-549865047 tempest-VolumesAssistedSnapshotsTest-549865047-project-member] Lock "02ef8bf0-077e-4653-98f5-9e6fef690fdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[423f8606-fbf3-4e16-b586-fe3a079bde36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:16 user nova-compute[75438]: No targets found.
Nov 09 02:08:16 user nova-compute[75438]: iSNS:
Nov 09 02:08:16 user nova-compute[75438]: No targets found.
Nov 09 02:08:16 user nova-compute[75438]: STATIC:
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:16 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:16 user nova-compute[75438]: No targets found.
Nov 09 02:08:16 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:16 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:16 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce9d6c-7849-4743-9e8b-5020cc16c0a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef497a8b-438d-4256-8aed-8a80ed0f949a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 (non-flash)
Nov 09 02:08:16 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba2c0f3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679'): ({'sdh'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Removing single pathed devices sdh {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d6db0-21fa-4721-b5d5-27ad419c0daa]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb433e5-ef20-4933-9ede-a6cca95060bf]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Flushing IO for device /dev/sdh {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdba4f09-14fd-4339-9860-f87a098d8308]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03e3aec-0b15-46c8-87a6-578a94984248]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] SCSI volumes sdh have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[980a7c33-2240-4447-ab3f-8aaafd00a49a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-9f91e539-c77d-40fd-9b6e-0280a1d34295 req-a4fd0e12-c6ce-4118-8843-543740647a14 service nova] [instance: 02ef8bf0-077e-4653-98f5-9e6fef690fdb] Received event network-vif-deleted-608d3a29-ea2e-4f08-9a14-334873c6f6d6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b04b0-dac6-4cd3-a2be-30d2f9f0748d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260]
Nov 09 02:08:16 user nova-compute[75438]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:16 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:16 user nova-compute[75438]: WARNING nova.compute.manager [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state active and task_state None.
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:16 user nova-compute[75438]: WARNING nova.compute.manager [req-d10caf75-f7ab-4ea5-bc2b-aec1f213f019 req-6a0c238a-a617-46e0-a8b8-7a1d50facc38 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state active and task_state None.
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ddacd56-1b95-4f96-9077-a7b613f19679 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c418c-d5cd-4790-ae67-fb1eb34b9da1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] <== disconnect_volume: return (385ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Deleting instance files /opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e_del
Nov 09 02:08:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Deletion of /opt/stack/data/nova/instances/59435d59-9004-4df4-adb7-e88577aa257e_del complete
Nov 09 02:08:16 user nova-compute[75438]: INFO nova.compute.manager [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Took 4.92 seconds to destroy the instance on the hypervisor.
Nov 09 02:08:16 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:08:16 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:08:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-6a273cca-2aac-4623-a6d6-641c0ce94aca req-d00266d9-7886-433e-bd3a-ef5a5105f990 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-deleted-b8b1235a-e337-42a8-8f96-46c00cd1422c {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:18 user nova-compute[75438]: INFO nova.compute.manager [req-6a273cca-2aac-4623-a6d6-641c0ce94aca req-d00266d9-7886-433e-bd3a-ef5a5105f990 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Neutron deleted interface b8b1235a-e337-42a8-8f96-46c00cd1422c; detaching it from the instance and deleting it from the info cache
Nov 09 02:08:18 user nova-compute[75438]: DEBUG nova.network.neutron [req-6a273cca-2aac-4623-a6d6-641c0ce94aca req-d00266d9-7886-433e-bd3a-ef5a5105f990 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [{"id": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "address": "fa:16:3e:ee:9b:bc", "network": {"id": "6309dda9-020a-478c-aa4e-d48780197563", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1947593551-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad8c5704-eb", "ovs_interfaceid": "ad8c5704-eb79-468a-98ce-afa53f7a2b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "address": "fa:16:3e:bc:7c:12", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.134", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2907c1c0-6a", "ovs_interfaceid": "2907c1c0-6a46-4f04-8511-569ba9ba63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d88f402e-ff60-4542-9d92-683833d89cb9", "address": "fa:16:3e:a6:16:b2", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd88f402e-ff", "ovs_interfaceid": "d88f402e-ff60-4542-9d92-683833d89cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "address": "fa:16:3e:83:1d:f7", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b43caae-cb", "ovs_interfaceid": "5b43caae-cb58-41b0-b9ab-169f1ffd5299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "address": "fa:16:3e:c8:11:1a", "network": {"id": "c92dbaf9-2b75-441e-b9d4-9781fbd2c7bc", "bridge": "br-int", "label": "tempest-device-tagging-net1-1017375626", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86e311b5-32", "ovs_interfaceid": "86e311b5-32c1-41b5-98a8-4aaaac57e470", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "address": "fa:16:3e:bd:f5:af", "network": {"id": "73118307-6aa4-4c75-9415-92270845f019", "bridge": "br-int", "label": "tempest-device-tagging-net2-450683599", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "af8aef490395493a88d8812a79b6f079", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59faaff1-46", "ovs_interfaceid": "59faaff1-46be-4ca5-b04f-1ba05fd992fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-6a273cca-2aac-4623-a6d6-641c0ce94aca req-d00266d9-7886-433e-bd3a-ef5a5105f990 service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Detach interface failed, port_id=b8b1235a-e337-42a8-8f96-46c00cd1422c, reason: Instance 59435d59-9004-4df4-adb7-e88577aa257e could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:20 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Took 3.74 seconds to deallocate network for instance.
Nov 09 02:08:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-6dba5983-166a-4638-88f7-6e045a9f581b req-cc79166e-d39d-4178-b751-a3537e5f7e0d service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-deleted-59faaff1-46be-4ca5-b04f-1ba05fd992fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-6dba5983-166a-4638-88f7-6e045a9f581b req-cc79166e-d39d-4178-b751-a3537e5f7e0d service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-deleted-ad8c5704-eb79-468a-98ce-afa53f7a2b90 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-6dba5983-166a-4638-88f7-6e045a9f581b req-cc79166e-d39d-4178-b751-a3537e5f7e0d service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-deleted-86e311b5-32c1-41b5-98a8-4aaaac57e470 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-6dba5983-166a-4638-88f7-6e045a9f581b req-cc79166e-d39d-4178-b751-a3537e5f7e0d service nova] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Received event network-vif-deleted-5b43caae-cb58-41b0-b9ab-169f1ffd5299 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:20 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdl (vdc) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:08:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:08:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=25.388259887695312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Applying migration context for instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 as it has an incoming, in-progress migration 569b60e8-4339-4c03-a366-3a1dd586639f. Migration status is finished {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 02:08:24 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating resource usage from migration 569b60e8-4339-4c03-a366-3a1dd586639f
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 59435d59-9004-4df4-adb7-e88577aa257e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Migration 569b60e8-4339-4c03-a366-3a1dd586639f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:08:24 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:08:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:08:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating instance_info_cache with network_info: [{"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-58220e40-bfca-4be5-a3af-d1011f77e1a8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:08:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:30 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 is timed out.
Nov 09 02:08:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Successfully detached device vdb from instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 from the live domain config.
Nov 09 02:08:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXscDUJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'f85746e7-c2e7-4e22-84a9-09c692f13714'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:30 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c47dfda-9e06-4e03-8749-b42237712f66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:30 user nova-compute[75438]: No targets found.
Nov 09 02:08:30 user nova-compute[75438]: iSNS:
Nov 09 02:08:30 user nova-compute[75438]: No targets found.
Nov 09 02:08:30 user nova-compute[75438]: STATIC:
Nov 09 02:08:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714
Nov 09 02:08:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:30 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:30 user nova-compute[75438]: No targets found.
Nov 09 02:08:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:31 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:31 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473a63d-fa8c-46b9-8f10-5e68cf088719]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f427e80-2072-4ac2-b1d3-6b6860737de9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba30e8e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714'): ({'sde'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Removing single pathed devices sde {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370e243-4f9f-402b-b136-189bfbc05c74]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[87741939-7ac1-4669-8017-ee75818eb840]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Flushing IO for device /dev/sde {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f0710a-9fb5-47a3-990c-5f76f1eb854a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4633411-4166-4fa1-b7de-d1da138e55f4]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eaaec9-de1a-4258-98a8-7ada889503e9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd782a49-3391-4570-97ff-40129093a4c9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260]
Nov 09 02:08:31 user nova-compute[75438]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f85746e7-c2e7-4e22-84a9-09c692f13714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7018cf47-fe65-4047-b00a-b86cb9d81cdf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] <== disconnect_volume: return (353ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lazy-loading 'flavor' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-15330066-a19e-443d-8c07-2cb616277d57 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:34 user nova-compute[75438]: INFO nova.compute.manager [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] [instance: 59435d59-9004-4df4-adb7-e88577aa257e] Took 14.01 seconds to detach 3 volumes for instance.
Nov 09 02:08:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:34 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:08:34 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:08:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:34 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Deleted allocations for instance 59435d59-9004-4df4-adb7-e88577aa257e
Nov 09 02:08:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-305a68cc-2ff7-4b73-ad31-6efc8c86380f tempest-TaggedBootDevicesTest_v242-938311404 tempest-TaggedBootDevicesTest_v242-938311404-project-member] Lock "59435d59-9004-4df4-adb7-e88577aa257e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.207s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-changed-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing instance network info cache due to event network-changed-baa25161-34cc-4878-a6dd-45c4c921d337. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:08:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] Acquiring lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] Acquired lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Refreshing network info cache for port baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:08:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updated VIF entry in instance network info cache for port baa25161-34cc-4878-a6dd-45c4c921d337. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:08:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7dc5f43d-0fb7-46f9-8efb-488c8c789cdf req-e140176b-2828-454a-890d-1d8665c1070b service nova] Releasing lock "refresh_cache-b029c08b-ba97-4d48-b734-d8034f7a4cdf" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:41 user nova-compute[75438]: INFO nova.compute.manager [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Terminating instance
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b925501-bd71-459d-bf5f-ed3b98c6d40f req-7eb3211f-0447-4bdd-ad84-6fd0beae27e9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b925501-bd71-459d-bf5f-ed3b98c6d40f req-7eb3211f-0447-4bdd-ad84-6fd0beae27e9 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b925501-bd71-459d-bf5f-ed3b98c6d40f req-7eb3211f-0447-4bdd-ad84-6fd0beae27e9 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b925501-bd71-459d-bf5f-ed3b98c6d40f req-7eb3211f-0447-4bdd-ad84-6fd0beae27e9 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b925501-bd71-459d-bf5f-ed3b98c6d40f req-7eb3211f-0447-4bdd-ad84-6fd0beae27e9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b925501-bd71-459d-bf5f-ed3b98c6d40f req-7eb3211f-0447-4bdd-ad84-6fd0beae27e9 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-baa25161-34cc-4878-a6dd-45c4c921d337 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-c77e26c6-e2bc-4a50-beaf-16f1b2ab8a2b req-9cdde4e2-4dfe-40c0-aa53-3394fc59cac0 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c77e26c6-e2bc-4a50-beaf-16f1b2ab8a2b req-9cdde4e2-4dfe-40c0-aa53-3394fc59cac0 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c77e26c6-e2bc-4a50-beaf-16f1b2ab8a2b req-9cdde4e2-4dfe-40c0-aa53-3394fc59cac0 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c77e26c6-e2bc-4a50-beaf-16f1b2ab8a2b req-9cdde4e2-4dfe-40c0-aa53-3394fc59cac0 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-c77e26c6-e2bc-4a50-beaf-16f1b2ab8a2b req-9cdde4e2-4dfe-40c0-aa53-3394fc59cac0 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-c77e26c6-e2bc-4a50-beaf-16f1b2ab8a2b req-9cdde4e2-4dfe-40c0-aa53-3394fc59cac0 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Instance destroyed successfully.
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.objects.instance [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lazy-loading 'resources' on Instance uuid b029c08b-ba97-4d48-b734-d8034f7a4cdf {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaa25161-34, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d75ee219-11aa-4fed-a1f0-3d725dc60bac) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:df:7c,bridge_name='br-int',has_traffic_filtering=True,id=baa25161-34cc-4878-a6dd-45c4c921d337,network=Network(e4d6cf69-bf87-49a7-95d2-f2dee084241e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaa25161-34')
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6139ab9-94, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b99a4f85-04ed-456e-9625-3d30eeb41611) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3f:ac,bridge_name='br-int',has_traffic_filtering=True,id=e6139ab9-94c7-453f-94c5-7aff1ab71e36,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape6139ab9-94')
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2aeb576-f6, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93177bc8-ee15-4a00-9b08-6b5cf05f67c2) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: WARNING nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-baa25161-34cc-4878-a6dd-45c4c921d337 for instance with vm_state active and task_state deleting.
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-d2aeb576-f698-4162-8c21-516f32d7b87e for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: WARNING nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-d2aeb576-f698-4162-8c21-516f32d7b87e for instance with vm_state active and task_state deleting.
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: WARNING nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 for instance with vm_state active and task_state deleting.
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:43 user nova-compute[75438]: WARNING nova.compute.manager [req-813705b9-406b-418c-bfd3-0cc44547d799 req-a876b40e-a083-429a-88c3-0581459fd45d service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 for instance with vm_state active and task_state deleting.
Nov 09 02:08:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:6d:be,bridge_name='br-int',has_traffic_filtering=True,id=d2aeb576-f698-4162-8c21-516f32d7b87e,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2aeb576-f6')
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "73090444-eef2-45eb-adf7-9b5d92ec510b", "address": "fa:16:3e:60:12:8b", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73090444-ee", "ovs_interfaceid": "73090444-eef2-45eb-adf7-9b5d92ec510b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:44 user nova-compute[75438]: WARNING nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-e6139ab9-94c7-453f-94c5-7aff1ab71e36 for instance with vm_state active and task_state deleting.
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-73090444-eef2-45eb-adf7-9b5d92ec510b for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:44 user nova-compute[75438]: WARNING nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-73090444-eef2-45eb-adf7-9b5d92ec510b for instance with vm_state active and task_state deleting.
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-unplugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-unplugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Acquiring lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] No waiting events found dispatching network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:44 user nova-compute[75438]: WARNING nova.compute.manager [req-67a1a799-b65c-45c3-8e90-68aed7ecd28b req-7a4f29f3-a02d-4ba7-be33-b2fa7a5986a5 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received unexpected event network-vif-plugged-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 for instance with vm_state active and task_state deleting.
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73090444-ee, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc3e2d12-bcf8-4867-80b3-b961dd6c7d31) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:12:8b,bridge_name='br-int',has_traffic_filtering=True,id=73090444-eef2-45eb-adf7-9b5d92ec510b,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73090444-ee')
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fa8c648-58, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51b3650a-935e-4e5c-89da-ac5c81f182a4) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:fe:45,bridge_name='br-int',has_traffic_filtering=True,id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2,network=Network(945eeec3-ba44-41f3-aa97-6877e409fab4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fa8c648-58')
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f479e5a-1a, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df8c417d-3ace-4196-9232-c0e85cbe7d06) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:52:05,bridge_name='br-int',has_traffic_filtering=True,id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f479e5a-1a')
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-09T02:04:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1954477736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1954477736',id=11,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJp670PO5ZCHL/kjzfp0koxCQC6Mlek1m8L9qjApFXOBmF9RTXjOVscpdMa0nTwDaFTwvokJAl0iRase4qi/FDEJU7uD0HbO4tvNPa8ntOXGCuiyDBwyIX/bca7K5KFS6A==',key_name='tempest-keypair-607357076',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3673ddc6f74b73a90c4cb34ec4cebd',ramdisk_id='',reservation_id='r-kh2o7tnn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1212876191',owner_user_name='tempest-TaggedBootDevicesTest-1212876191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d48c574bcbe49239ff3d9eedc721b10',uuid=b029c08b-ba97-4d48-b734-d8034f7a4cdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converting VIF {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbae05ee5-b5, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c2d453a-8b91-4f02-88a8-2ae1754ab772) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:44 user nova-compute[75438]: INFO os_vif [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:8e:61,bridge_name='br-int',has_traffic_filtering=True,id=bae05ee5-b5b1-4fa9-aabf-c57fbc020d01,network=Network(7909e62f-eb53-4741-ac3a-4b4e5c92e30e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbae05ee5-b5')
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UWGpZPvC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d692d-da08-4f97-8463-5b0d4831f528]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]: iSNS:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]: STATIC:
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:44 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:44 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00698c5-721f-46c2-a7e0-3943b36d6920]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[01178c21-eaf8-4643-8e6d-4e983bbacba7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388'): ({'sdj'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Removing single pathed devices sdj {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d693a20-3c94-46c9-ad2f-4e46cc5b55da]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa882c9f-344c-47a7-9def-91d2337723c2]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Flushing IO for device /dev/sdj {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef82a5b-cf3b-4308-be56-679d0c997ff4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62718a73-b19e-4566-a344-a515dc2d62d5]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] SCSI volumes sdj have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c8111-cdff-4ae5-8615-702813e12789]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5c6aa-02d5-4a57-9e52-6d04de90e1b3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260]
Nov 09 02:08:44 user nova-compute[75438]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5cce59b-1c51-4e0d-998b-c42781fcc388 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2894e8-7c46-4dae-aea0-e21716c61988]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== disconnect_volume: return (352ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRNJmghT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b239589-da32-476b-8b2f-35ea5f537574]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]: iSNS:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]: STATIC:
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:44 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:44 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc774d1-9f8f-417f-b255-63f48f7d7408]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977504a-1e6f-41e2-8e43-d3d1a293ed88]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989'): ({'sdk'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Removing single pathed devices sdk {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4c1e5-632b-4639-8d98-8a55e4772686]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed419aa6-a3b8-402f-b68c-a74d791e602b]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Flushing IO for device /dev/sdk {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3480163e-bb80-4aed-87bc-68bc4161ceb8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[09750935-f3f7-4332-b266-7ad3faf32f81]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] SCSI volumes sdk have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b89c4f9-ed3d-46aa-8c9b-69ce02837c50]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[701edb37-7d8e-44a3-a891-49984a7df8e6]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260]
Nov 09 02:08:44 user nova-compute[75438]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce80beed-d13a-4405-83df-f450d331b989 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[331a2d8f-322c-47b3-9890-df21d2489200]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== disconnect_volume: return (340ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QDEWHRyG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[77751091-cfc8-4b30-b537-351aa5ba5df1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]: iSNS:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]: STATIC:
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:44 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:44 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:44 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:44 user nova-compute[75438]: No targets found.
Nov 09 02:08:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:44 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:44 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea73d0a-0c5b-42ac-ba7f-47b22626a898]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f4add-2cf7-44ef-93a2-e90f27ab67fb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:45 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:45 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b (non-flash)
Nov 09 02:08:45 user nova-compute[75438]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:45 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245ba5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b'): ({'sdl'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Removing single pathed devices sdl {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[284917f1-f487-4cb1-a511-1f57e71b8091]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0283e16-a72e-4b91-b24e-28ea8bc4be20]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Flushing IO for device /dev/sdl {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c376d12-0f54-45d6-af1f-490c698af0d7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d179236-7b7a-4e16-a6f7-ae583c25df7a]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] SCSI volumes sdl have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d41ecb-95a5-4c11-8a3c-ddec84abdfdc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe74d9-4762-4195-a6b1-5394d3660bf0]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260]
Nov 09 02:08:45 user nova-compute[75438]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee8bf43-ffec-4594-8286-830dea8c3a0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a74179-889d-498b-bf45-99d7042f16e8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] <== disconnect_volume: return (313ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Deleting instance files /opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf_del
Nov 09 02:08:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Deletion of /opt/stack/data/nova/instances/b029c08b-ba97-4d48-b734-d8034f7a4cdf_del complete
Nov 09 02:08:45 user nova-compute[75438]: INFO nova.compute.manager [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Took 3.90 seconds to destroy the instance on the hypervisor.
Nov 09 02:08:45 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:08:45 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:08:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5f862f2-675c-4886-9909-767c4cc832f3 req-765db2d8-fc2d-4a78-9c1f-127580b25523 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-deleted-73090444-eef2-45eb-adf7-9b5d92ec510b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:47 user nova-compute[75438]: INFO nova.compute.manager [req-f5f862f2-675c-4886-9909-767c4cc832f3 req-765db2d8-fc2d-4a78-9c1f-127580b25523 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Neutron deleted interface 73090444-eef2-45eb-adf7-9b5d92ec510b; detaching it from the instance and deleting it from the info cache
Nov 09 02:08:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-f5f862f2-675c-4886-9909-767c4cc832f3 req-765db2d8-fc2d-4a78-9c1f-127580b25523 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "address": "fa:16:3e:52:fe:45", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fa8c648-58", "ovs_interfaceid": "7fa8c648-589d-4f5e-9eae-e2e01afd3ad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5f862f2-675c-4886-9909-767c4cc832f3 req-765db2d8-fc2d-4a78-9c1f-127580b25523 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Detach interface failed, port_id=73090444-eef2-45eb-adf7-9b5d92ec510b, reason: Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:08:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-deleted-7fa8c648-589d-4f5e-9eae-e2e01afd3ad2 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:50 user nova-compute[75438]: INFO nova.compute.manager [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Neutron deleted interface 7fa8c648-589d-4f5e-9eae-e2e01afd3ad2; detaching it from the instance and deleting it from the info cache
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.network.neutron [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "address": "fa:16:3e:fd:52:05", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f479e5a-1a", "ovs_interfaceid": "9f479e5a-1ae3-432b-9d14-a51ea1e13e42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Detach interface failed, port_id=7fa8c648-589d-4f5e-9eae-e2e01afd3ad2, reason: Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-deleted-9f479e5a-1ae3-432b-9d14-a51ea1e13e42 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:50 user nova-compute[75438]: INFO nova.compute.manager [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Neutron deleted interface 9f479e5a-1ae3-432b-9d14-a51ea1e13e42; detaching it from the instance and deleting it from the info cache
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.network.neutron [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [{"id": "baa25161-34cc-4878-a6dd-45c4c921d337", "address": "fa:16:3e:10:df:7c", "network": {"id": "e4d6cf69-bf87-49a7-95d2-f2dee084241e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-838284904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaa25161-34", "ovs_interfaceid": "baa25161-34cc-4878-a6dd-45c4c921d337", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "address": "fa:16:3e:a6:3f:ac", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6139ab9-94", "ovs_interfaceid": "e6139ab9-94c7-453f-94c5-7aff1ab71e36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2aeb576-f698-4162-8c21-516f32d7b87e", "address": "fa:16:3e:d4:6d:be", "network": {"id": "945eeec3-ba44-41f3-aa97-6877e409fab4", "bridge": "br-int", "label": "tempest-device-tagging-net1-766241134", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2aeb576-f6", "ovs_interfaceid": "d2aeb576-f698-4162-8c21-516f32d7b87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "address": "fa:16:3e:b3:8e:61", "network": {"id": "7909e62f-eb53-4741-ac3a-4b4e5c92e30e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1369815698", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2e3673ddc6f74b73a90c4cb34ec4cebd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbae05ee5-b5", "ovs_interfaceid": "bae05ee5-b5b1-4fa9-aabf-c57fbc020d01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-7dadf44e-9cb8-4c9f-af75-a584dbfb158e req-d771e3bf-a836-4048-a9d5-ba3d734241e8 service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Detach interface failed, port_id=9f479e5a-1ae3-432b-9d14-a51ea1e13e42, reason: Instance b029c08b-ba97-4d48-b734-d8034f7a4cdf could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:08:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:50 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:51 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Took 5.64 seconds to deallocate network for instance.
Nov 09 02:08:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-866c82b9-780b-417a-9866-843c21b14056 req-e58a8246-ae2d-4282-b2b5-acd1f41b371c service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-deleted-baa25161-34cc-4878-a6dd-45c4c921d337 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-866c82b9-780b-417a-9866-843c21b14056 req-e58a8246-ae2d-4282-b2b5-acd1f41b371c service nova] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Received event network-vif-deleted-bae05ee5-b5b1-4fa9-aabf-c57fbc020d01 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:52 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:08:52 user nova-compute[75438]: INFO nova.compute.claims [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Claim successful on node user
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:08:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.policy [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95d2465b0af4dcab397b5ccc2809c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4b29710bb14b8fb9714109aec43dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:08:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Creating image(s)
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "/opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "/opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.256s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:54 user nova-compute[75438]: INFO nova.compute.manager [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] [instance: b029c08b-ba97-4d48-b734-d8034f7a4cdf] Took 3.04 seconds to detach 3 volumes for instance.
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.231s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk 1073741824" returned: 0 in 0.066s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Successfully created port: cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.205s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Cannot resize image /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Ensure instance console log exists: /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:54 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Deleted allocations for instance b029c08b-ba97-4d48-b734-d8034f7a4cdf
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-928ed434-70c7-4f3e-b28f-9c81eeab5273 tempest-TaggedBootDevicesTest-1212876191 tempest-TaggedBootDevicesTest-1212876191-project-member] Lock "b029c08b-ba97-4d48-b734-d8034f7a4cdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.376s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Successfully updated port: cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-changed-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Refreshing instance network info cache due to event network-changed-cca4d3f1-d39a-4163-aa83-b0df831b92cb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:08:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Instance network_info: |[{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.neutron [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Refreshing network info cache for port cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Start _get_guest_xml network_info=[{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:08:55 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:08:55 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419065901',display_name='tempest-ServerActionsTestOtherA-server-419065901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419065901',id=13,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-ykon7erz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=e2cc1833-7812-4534-aa5a-b793f37b5254,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'pci_devices' on Instance uuid e2cc1833-7812-4534-aa5a-b793f37b5254 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:08:55 user nova-compute[75438]:   <uuid>e2cc1833-7812-4534-aa5a-b793f37b5254</uuid>
Nov 09 02:08:55 user nova-compute[75438]:   <name>instance-0000000d</name>
Nov 09 02:08:55 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:08:55 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:08:55 user nova-compute[75438]:   <metadata>
Nov 09 02:08:55 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:08:55 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:08:55 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherA-server-419065901</nova:name>
Nov 09 02:08:55 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:08:55</nova:creationTime>
Nov 09 02:08:55 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:08:55 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:08:55 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:08:55 user nova-compute[75438]:       <nova:owner>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:user uuid="e95d2465b0af4dcab397b5ccc2809c59">tempest-ServerActionsTestOtherA-1813489270-project-member</nova:user>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:project uuid="7a4b29710bb14b8fb9714109aec43dc6">tempest-ServerActionsTestOtherA-1813489270</nova:project>
Nov 09 02:08:55 user nova-compute[75438]:       </nova:owner>
Nov 09 02:08:55 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:08:55 user nova-compute[75438]:       <nova:ports>
Nov 09 02:08:55 user nova-compute[75438]:         <nova:port uuid="cca4d3f1-d39a-4163-aa83-b0df831b92cb">
Nov 09 02:08:55 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 02:08:55 user nova-compute[75438]:         </nova:port>
Nov 09 02:08:55 user nova-compute[75438]:       </nova:ports>
Nov 09 02:08:55 user nova-compute[75438]:     </nova:instance>
Nov 09 02:08:55 user nova-compute[75438]:   </metadata>
Nov 09 02:08:55 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:08:55 user nova-compute[75438]:     <system>
Nov 09 02:08:55 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:08:55 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:08:55 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:08:55 user nova-compute[75438]:       <entry name="serial">e2cc1833-7812-4534-aa5a-b793f37b5254</entry>
Nov 09 02:08:55 user nova-compute[75438]:       <entry name="uuid">e2cc1833-7812-4534-aa5a-b793f37b5254</entry>
Nov 09 02:08:55 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:08:55 user nova-compute[75438]:     </system>
Nov 09 02:08:55 user nova-compute[75438]:   </sysinfo>
Nov 09 02:08:55 user nova-compute[75438]:   <os>
Nov 09 02:08:55 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:08:55 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:08:55 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:08:55 user nova-compute[75438]:   </os>
Nov 09 02:08:55 user nova-compute[75438]:   <features>
Nov 09 02:08:55 user nova-compute[75438]:     <acpi/>
Nov 09 02:08:55 user nova-compute[75438]:     <apic/>
Nov 09 02:08:55 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:08:55 user nova-compute[75438]:   </features>
Nov 09 02:08:55 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:08:55 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:08:55 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:08:55 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:08:55 user nova-compute[75438]:   </clock>
Nov 09 02:08:55 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:08:55 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:08:55 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:08:55 user nova-compute[75438]:   </cpu>
Nov 09 02:08:55 user nova-compute[75438]:   <devices>
Nov 09 02:08:55 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:08:55 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:08:55 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk"/>
Nov 09 02:08:55 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:08:55 user nova-compute[75438]:     </disk>
Nov 09 02:08:55 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:08:55 user nova-compute[75438]:       <mac address="fa:16:3e:9e:2c:e3"/>
Nov 09 02:08:55 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:08:55 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:08:55 user nova-compute[75438]:       <target dev="tapcca4d3f1-d3"/>
Nov 09 02:08:55 user nova-compute[75438]:     </interface>
Nov 09 02:08:55 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:08:55 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/console.log" append="off"/>
Nov 09 02:08:55 user nova-compute[75438]:     </serial>
Nov 09 02:08:55 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:08:55 user nova-compute[75438]:     <video>
Nov 09 02:08:55 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:08:55 user nova-compute[75438]:     </video>
Nov 09 02:08:55 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:08:55 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:08:55 user nova-compute[75438]:     </rng>
Nov 09 02:08:55 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:08:55 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:08:55 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:08:55 user nova-compute[75438]:     </memballoon>
Nov 09 02:08:55 user nova-compute[75438]:   </devices>
Nov 09 02:08:55 user nova-compute[75438]: </domain>
Nov 09 02:08:55 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419065901',display_name='tempest-ServerActionsTestOtherA-server-419065901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419065901',id=13,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-ykon7erz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=e2cc1833-7812-4534-aa5a-b793f37b5254,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG os_vif [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3328aa9e-6207-52d3-aa4c-d8d83663fc9b', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcca4d3f1-d3, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcca4d3f1-d3, col_values=(('qos', UUID('8b9a13e9-43a6-43c9-8cf2-a41ecc328625')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcca4d3f1-d3, col_values=(('external_ids', {'iface-id': 'cca4d3f1-d39a-4163-aa83-b0df831b92cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:2c:e3', 'vm-uuid': 'e2cc1833-7812-4534-aa5a-b793f37b5254'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:55 user nova-compute[75438]: INFO os_vif [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3')
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No VIF found with MAC fa:16:3e:9e:2c:e3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.neutron [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updated VIF entry in instance network info cache for port cca4d3f1-d39a-4163-aa83-b0df831b92cb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG nova.network.neutron [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9df07608-ac8e-4f80-860b-ec07eee64326 req-ba8698a8-29d9-4f5c-836c-66f6431b97db service nova] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Port 9c8b67f2-a61a-4580-85c9-ee3583275dc7 binding to destination host user is already ACTIVE {{(pid=75438) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 02:08:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:08:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:08:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Creating tmpfile /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/tmpkybyf3qg to verify with other compute node that the instance is on the same shared storage. {{(pid=75438) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-8d1f00f5-d43d-468a-97f5-62e2a00fc972 req-b9a676c1-16d5-4f7a-a132-3faa3e845b9f service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8d1f00f5-d43d-468a-97f5-62e2a00fc972 req-b9a676c1-16d5-4f7a-a132-3faa3e845b9f service nova] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8d1f00f5-d43d-468a-97f5-62e2a00fc972 req-b9a676c1-16d5-4f7a-a132-3faa3e845b9f service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8d1f00f5-d43d-468a-97f5-62e2a00fc972 req-b9a676c1-16d5-4f7a-a132-3faa3e845b9f service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-8d1f00f5-d43d-468a-97f5-62e2a00fc972 req-b9a676c1-16d5-4f7a-a132-3faa3e845b9f service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] No waiting events found dispatching network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:57 user nova-compute[75438]: WARNING nova.compute.manager [req-8d1f00f5-d43d-468a-97f5-62e2a00fc972 req-b9a676c1-16d5-4f7a-a132-3faa3e845b9f service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received unexpected event network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb for instance with vm_state building and task_state spawning.
Nov 09 02:08:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-78fd16fc-ddb5-4213-9ffb-1714aa2680e1 req-f7bc7bfb-5eea-408f-842e-4db9e3c5c41b service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-78fd16fc-ddb5-4213-9ffb-1714aa2680e1 req-f7bc7bfb-5eea-408f-842e-4db9e3c5c41b service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-78fd16fc-ddb5-4213-9ffb-1714aa2680e1 req-f7bc7bfb-5eea-408f-842e-4db9e3c5c41b service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-78fd16fc-ddb5-4213-9ffb-1714aa2680e1 req-f7bc7bfb-5eea-408f-842e-4db9e3c5c41b service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-78fd16fc-ddb5-4213-9ffb-1714aa2680e1 req-f7bc7bfb-5eea-408f-842e-4db9e3c5c41b service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:57 user nova-compute[75438]: WARNING nova.compute.manager [req-78fd16fc-ddb5-4213-9ffb-1714aa2680e1 req-f7bc7bfb-5eea-408f-842e-4db9e3c5c41b service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state resized and task_state resize_reverting.
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance destroyed successfully.
Nov 09 02:08:58 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'resources' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8b67f2-a6, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87a7e2a3-7c6c-44bd-a1f3-d3e5c4317714) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:08:58 user nova-compute[75438]: INFO os_vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6')
Nov 09 02:08:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:08:58 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[03662b57-7b12-401f-a0b5-87d52ffbe309]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:08:58 user nova-compute[75438]: No targets found.
Nov 09 02:08:58 user nova-compute[75438]: iSNS:
Nov 09 02:08:58 user nova-compute[75438]: No targets found.
Nov 09 02:08:58 user nova-compute[75438]: STATIC:
Nov 09 02:08:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:08:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:08:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:08:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:08:58 user nova-compute[75438]: FIRMWARE:
Nov 09 02:08:58 user nova-compute[75438]: No targets found.
Nov 09 02:08:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:08:58 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:08:58 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe57fe-6338-4fcb-b8fa-8a81b9b7ff49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b658de0f-6cf2-4e92-8887-a6aeba92fb03]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:58 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:08:58 user nova-compute[75438]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:08:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba2c0f3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d972bcf8-a1f6-45b5-b027-b44be24b49f2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea53c50-b2fb-43d0-9421-55cf0669ee73]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[273dccc3-31d0-4232-a795-986e6612a0fd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad37ff0-ea27-4b44-8e81-6d2b9f563409]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[821047f7-722e-4c29-90df-c35c7ce7179d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea3a256-ae2e-4600-8960-c081069f27b7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]
Nov 09 02:08:58 user nova-compute[75438]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.
Nov 09 02:08:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8294036-d6bf-431f-a3b9-ee87a2de57ef]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== disconnect_volume: return (353ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:08:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:08:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d3758e4-16be-4c50-b0b7-4397ddcd72bf req-e8177fb2-0185-426d-a0b2-f1b529026082 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:08:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d3758e4-16be-4c50-b0b7-4397ddcd72bf req-e8177fb2-0185-426d-a0b2-f1b529026082 service nova] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:08:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d3758e4-16be-4c50-b0b7-4397ddcd72bf req-e8177fb2-0185-426d-a0b2-f1b529026082 service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:08:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d3758e4-16be-4c50-b0b7-4397ddcd72bf req-e8177fb2-0185-426d-a0b2-f1b529026082 service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:08:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d3758e4-16be-4c50-b0b7-4397ddcd72bf req-e8177fb2-0185-426d-a0b2-f1b529026082 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] No waiting events found dispatching network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:08:59 user nova-compute[75438]: WARNING nova.compute.manager [req-0d3758e4-16be-4c50-b0b7-4397ddcd72bf req-e8177fb2-0185-426d-a0b2-f1b529026082 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received unexpected event network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb for instance with vm_state building and task_state spawning.
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-1b53450b-0f5d-408c-97a8-717eaa99d633 req-cf665d1d-340f-4799-a894-964cc00a621e service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1b53450b-0f5d-408c-97a8-717eaa99d633 req-cf665d1d-340f-4799-a894-964cc00a621e service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1b53450b-0f5d-408c-97a8-717eaa99d633 req-cf665d1d-340f-4799-a894-964cc00a621e service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1b53450b-0f5d-408c-97a8-717eaa99d633 req-cf665d1d-340f-4799-a894-964cc00a621e service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-1b53450b-0f5d-408c-97a8-717eaa99d633 req-cf665d1d-340f-4799-a894-964cc00a621e service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:00 user nova-compute[75438]: WARNING nova.compute.manager [req-1b53450b-0f5d-408c-97a8-717eaa99d633 req-cf665d1d-340f-4799-a894-964cc00a621e service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state resized and task_state resize_reverting.
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:09:00 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Instance spawned successfully.
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'migration_context' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:09:00 user nova-compute[75438]: INFO nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.objects.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Object Instance<05bf2ae1-5578-4573-b0c7-9ce14999da93> lazy-loaded attributes: resources,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:09:00 user nova-compute[75438]: INFO nova.compute.manager [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Took 7.70 seconds to build instance.
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7d868d6a-c6ac-445e-adc4-862bebd21558 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.849s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.536s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:00 user nova-compute[75438]: INFO nova.compute.manager [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Terminating instance
Nov 09 02:09:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: INFO nova.compute.manager [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Swapping old allocation on dict_keys(['bfe02387-c3a8-4a94-8642-7f0b913b986c']) held by migration 569b60e8-4339-4c03-a366-3a1dd586639f for instance
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Overwriting current allocation {'allocations': {'bfe02387-c3a8-4a94-8642-7f0b913b986c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 17}}, 'project_id': 'a20628afe4aa4c0aae9c883d4531cc74', 'user_id': 'be52867f38a447129d9960106a2525f7', 'consumer_generation': 1} on consumer 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-vif-unplugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] No waiting events found dispatching network-vif-unplugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-vif-unplugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] Acquiring lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] No waiting events found dispatching network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:01 user nova-compute[75438]: WARNING nova.compute.manager [req-e044c55e-e5b3-44f5-ac1d-290f2861af24 req-6f78a43c-de84-42fa-a976-667e87152cfa service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received unexpected event network-vif-plugged-72486962-8dbd-4bd1-99d3-14bf7a29caa3 for instance with vm_state active and task_state deleting.
Nov 09 02:09:01 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Instance destroyed successfully.
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.objects.instance [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lazy-loading 'resources' on Instance uuid 58220e40-bfca-4be5-a3af-d1011f77e1a8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1445481304',display_name='tempest-TestVolumeSwap-server-1445481304',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1445481304',id=7,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa5BbppXwXFUbgfscdBgd3UtwPgMvKvDxVn0DPJQaf+LfGLVmgeA6rVFMIF0lkezSrDCLD+Mp5Hl0VQn7HP6vw63O5GsWOMfc9go2ctj0KT+ympMbudTZkUgb09z2uXgg==',key_name='tempest-keypair-301964538',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='85ebb6bddc26465a9a4257132c4bf0aa',ramdisk_id='',reservation_id='r-5o9q4b0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1441210545',owner_user_name='tempest-TestVolumeSwap-1441210545-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f67183f87b54ac79256ea3fc01744c5',uuid=58220e40-bfca-4be5-a3af-d1011f77e1a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Converting VIF {"id": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "address": "fa:16:3e:86:01:22", "network": {"id": "6dcab848-e4bb-469e-ab97-897f9bd603df", "bridge": "br-int", "label": "tempest-TestVolumeSwap-393948471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "85ebb6bddc26465a9a4257132c4bf0aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72486962-8d", "ovs_interfaceid": "72486962-8dbd-4bd1-99d3-14bf7a29caa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG os_vif [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72486962-8d, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66db3d17-6f56-4d51-8a08-200044f7f4e7) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:09:01 user nova-compute[75438]: INFO os_vif [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:01:22,bridge_name='br-int',has_traffic_filtering=True,id=72486962-8dbd-4bd1-99d3-14bf7a29caa3,network=Network(6dcab848-e4bb-469e-ab97-897f9bd603df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72486962-8d')
Nov 09 02:09:01 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Deleting instance files /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8_del
Nov 09 02:09:01 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Deletion of /opt/stack/data/nova/instances/58220e40-bfca-4be5-a3af-d1011f77e1a8_del complete
Nov 09 02:09:01 user nova-compute[75438]: INFO nova.compute.manager [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 09 02:09:01 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:09:01 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG os_brick.utils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f21337-2ed3-4973-8d5b-1b12b4c530a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0253b8c3-32d0-4fa9-88ad-55fa2cf3058b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4c2e7-51a6-40ac-a390-3e0fd4ee5b58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4bb4e9-ba14-4c80-a8ef-3141a99634af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:09:02 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Took 0.97 seconds to deallocate network for instance.
Nov 09 02:09:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-e42f6f55-3f95-4224-a841-dcfea347bff6 req-7177adb5-ae51-465d-bc9f-754168e5a1da service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Received event network-vif-deleted-72486962-8dbd-4bd1-99d3-14bf7a29caa3 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:02 user nova-compute[75438]: INFO nova.compute.manager [req-e42f6f55-3f95-4224-a841-dcfea347bff6 req-7177adb5-ae51-465d-bc9f-754168e5a1da service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Neutron deleted interface 72486962-8dbd-4bd1-99d3-14bf7a29caa3; detaching it from the instance and deleting it from the info cache
Nov 09 02:09:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-e42f6f55-3f95-4224-a841-dcfea347bff6 req-7177adb5-ae51-465d-bc9f-754168e5a1da service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:09:02 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6e3546-51ea-4839-9b10-42bc8ce5bc3c]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG os_brick.utils [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-e42f6f55-3f95-4224-a841-dcfea347bff6 req-7177adb5-ae51-465d-bc9f-754168e5a1da service nova] [instance: 58220e40-bfca-4be5-a3af-d1011f77e1a8] Detach interface failed, port_id=72486962-8dbd-4bd1-99d3-14bf7a29caa3, reason: Instance 58220e40-bfca-4be5-a3af-d1011f77e1a8 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:03 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:09:03 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:09:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:03 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Deleted allocations for instance 58220e40-bfca-4be5-a3af-d1011f77e1a8
Nov 09 02:09:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-227cff4c-4855-4862-82a5-db7fd9ec35b7 tempest-TestVolumeSwap-1441210545 tempest-TestVolumeSwap-1441210545-project-member] Lock "58220e40-bfca-4be5-a3af-d1011f77e1a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.775s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:05 user nova-compute[75438]: WARNING nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] While synchronizing instance power states, found 5 instances in the database and 4 instances on the hypervisor.
Nov 09 02:09:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid e2cc1833-7812-4534-aa5a-b793f37b5254 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:05 user nova-compute[75438]: INFO nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:15 user nova-compute[75438]: INFO nova.compute.manager [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Unrescuing
Nov 09 02:09:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:09:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:09:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:09:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:09:16 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'flavor' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:09:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-8ac56303-1ba0-423a-9beb-37be14000846 req-249d4029-f317-4324-aba9-75610d7995fb service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8ac56303-1ba0-423a-9beb-37be14000846 req-249d4029-f317-4324-aba9-75610d7995fb service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8ac56303-1ba0-423a-9beb-37be14000846 req-249d4029-f317-4324-aba9-75610d7995fb service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8ac56303-1ba0-423a-9beb-37be14000846 req-249d4029-f317-4324-aba9-75610d7995fb service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-8ac56303-1ba0-423a-9beb-37be14000846 req-249d4029-f317-4324-aba9-75610d7995fb service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:17 user nova-compute[75438]: WARNING nova.compute.manager [req-8ac56303-1ba0-423a-9beb-37be14000846 req-249d4029-f317-4324-aba9-75610d7995fb service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:09:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:17 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance destroyed successfully.
Nov 09 02:09:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-3d43cf33-2c96-427d-a900-cb7bcdcca937 req-04dadb9f-957a-4196-8a48-79acb56c596a service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3d43cf33-2c96-427d-a900-cb7bcdcca937 req-04dadb9f-957a-4196-8a48-79acb56c596a service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3d43cf33-2c96-427d-a900-cb7bcdcca937 req-04dadb9f-957a-4196-8a48-79acb56c596a service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3d43cf33-2c96-427d-a900-cb7bcdcca937 req-04dadb9f-957a-4196-8a48-79acb56c596a service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-3d43cf33-2c96-427d-a900-cb7bcdcca937 req-04dadb9f-957a-4196-8a48-79acb56c596a service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:19 user nova-compute[75438]: WARNING nova.compute.manager [req-3d43cf33-2c96-427d-a900-cb7bcdcca937 req-04dadb9f-957a-4196-8a48-79acb56c596a service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:09:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:21 user nova-compute[75438]: WARNING nova.compute.manager [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:21 user nova-compute[75438]: WARNING nova.compute.manager [req-dc8af1b4-06b9-4fb4-85b8-4f3b0983b657 req-c1c1aec6-899b-4fee-abb0-2ff1c185f937 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:09:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f98bad3f-28c1-40ac-a4eb-1b394e3aaf5e tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:21 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.288s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=25.373638153076172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:09:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:09:27 user nova-compute[75438]: INFO nova.compute.claims [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Claim successful on node user
Nov 09 02:09:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:09:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.policy [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd603c6cb567c414a9c1fef7259b0f124', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e41745ea4d9482b8bf124615afcf332', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:09:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Creating image(s)
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.255s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.286s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk 1073741824" returned: 0 in 0.146s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.458s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.220s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Cannot resize image /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Ensure instance console log exists: /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Successfully created port: 3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:09:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Starting finish_revert_migration {{(pid=75438) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start _get_guest_xml network_info=[{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '257cbdf5-ad05-4904-994c-ac5fdd1c8ddb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '05bf2ae1-5578-4573-b0c7-9ce14999da93', 'attached_at': '2023-11-09T02:09:31.000000', 'detached_at': '', 'volume_id': '12d5308d-cae3-4796-b701-cd59e18bf553', 'serial': '12d5308d-cae3-4796-b701-cd59e18bf553'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:31 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:31 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'vcpu_model' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Successfully updated port: 3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:09:31 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:09:31 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:09:31 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing instance network info cache due to event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[75093cb6-9c9a-4bb8-ba96-926414fa9ec7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:09:31 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b958f-fd47-49c7-af8a-c6f1d01d211e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553] added
Nov 09 02:09:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b74a2f-541a-417f-8df5-ae9339220122]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[baee1202-0903-4ab3-9bcd-e28b254e3e27]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMokQxc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvMokQxc" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a16f06-c97b-47d5-8ae6-ca4064dbf767]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvMokQxc'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774ec4e-c90a-42a0-8b9e-d481c9e5b98d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e209ca-e1be-4b61-8698-5eef8a6f7f8f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:09:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:09:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:09:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b1cc41-c9e5-4eb2-95e0-4c8951d80847]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]
Nov 09 02:09:32 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.
Nov 09 02:09:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5ee7ff-56d3-469d-ba14-fa07244f1742]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eeaa2c-e72c-43c4-a9ad-ca7a9828a85d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:09:32 user nova-compute[75438]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:09:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:09:32 user nova-compute[75438]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:09:32 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[971986af-903d-4d03-b8e4-a1a81720383b]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance network_info: |[{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Start _get_guest_xml network_info=[{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:09:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1933050020',display_name='tempest-ServerStableDeviceRescueTest-server-1933050020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1933050020',id=14,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKDpuWXe8laBaRb9YE1a4T307OlX9DrMSCdp2D+FiV3QrJsddtQiEFNfKYtruYEV/Te6PBx6sTuKx1fNq7XM5ic/fY3vZT/Ur/1hc/vA6eRDgpCFt7xwG0WlMZpFLqUvA==',key_name='tempest-keypair-1023383383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e41745ea4d9482b8bf124615afcf332',ramdisk_id='',reservation_id='r-ar1gm8na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1045361722',owner_user_name='tempest-ServerStableDeviceRescueTest-1045361722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d603c6cb567c414a9c1fef7259b0f124',uuid=f2c26e99-e089-49f5-9499-6bf035067512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converting VIF {"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'pci_devices' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:09:32 user nova-compute[75438]:   <uuid>f2c26e99-e089-49f5-9499-6bf035067512</uuid>
Nov 09 02:09:32 user nova-compute[75438]:   <name>instance-0000000e</name>
Nov 09 02:09:32 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:09:32 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:09:32 user nova-compute[75438]:   <metadata>
Nov 09 02:09:32 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:09:32 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:09:32 user nova-compute[75438]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1933050020</nova:name>
Nov 09 02:09:32 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:09:32</nova:creationTime>
Nov 09 02:09:32 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:09:32 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:09:32 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:09:32 user nova-compute[75438]:       <nova:owner>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:user uuid="d603c6cb567c414a9c1fef7259b0f124">tempest-ServerStableDeviceRescueTest-1045361722-project-member</nova:user>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:project uuid="1e41745ea4d9482b8bf124615afcf332">tempest-ServerStableDeviceRescueTest-1045361722</nova:project>
Nov 09 02:09:32 user nova-compute[75438]:       </nova:owner>
Nov 09 02:09:32 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:09:32 user nova-compute[75438]:       <nova:ports>
Nov 09 02:09:32 user nova-compute[75438]:         <nova:port uuid="3ab12034-c674-490a-be6d-db79cecc5b53">
Nov 09 02:09:32 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:09:32 user nova-compute[75438]:         </nova:port>
Nov 09 02:09:32 user nova-compute[75438]:       </nova:ports>
Nov 09 02:09:32 user nova-compute[75438]:     </nova:instance>
Nov 09 02:09:32 user nova-compute[75438]:   </metadata>
Nov 09 02:09:32 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:09:32 user nova-compute[75438]:     <system>
Nov 09 02:09:32 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:09:32 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:09:32 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:09:32 user nova-compute[75438]:       <entry name="serial">f2c26e99-e089-49f5-9499-6bf035067512</entry>
Nov 09 02:09:32 user nova-compute[75438]:       <entry name="uuid">f2c26e99-e089-49f5-9499-6bf035067512</entry>
Nov 09 02:09:32 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:09:32 user nova-compute[75438]:     </system>
Nov 09 02:09:32 user nova-compute[75438]:   </sysinfo>
Nov 09 02:09:32 user nova-compute[75438]:   <os>
Nov 09 02:09:32 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:09:32 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:09:32 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:09:32 user nova-compute[75438]:   </os>
Nov 09 02:09:32 user nova-compute[75438]:   <features>
Nov 09 02:09:32 user nova-compute[75438]:     <acpi/>
Nov 09 02:09:32 user nova-compute[75438]:     <apic/>
Nov 09 02:09:32 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:09:32 user nova-compute[75438]:   </features>
Nov 09 02:09:32 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:09:32 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:09:32 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:09:32 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:09:32 user nova-compute[75438]:   </clock>
Nov 09 02:09:32 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:09:32 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:09:32 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:09:32 user nova-compute[75438]:   </cpu>
Nov 09 02:09:32 user nova-compute[75438]:   <devices>
Nov 09 02:09:32 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:09:32 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:09:32 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk"/>
Nov 09 02:09:32 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:09:32 user nova-compute[75438]:     </disk>
Nov 09 02:09:32 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:09:32 user nova-compute[75438]:       <mac address="fa:16:3e:7d:5e:ef"/>
Nov 09 02:09:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:09:32 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:09:32 user nova-compute[75438]:       <target dev="tap3ab12034-c6"/>
Nov 09 02:09:32 user nova-compute[75438]:     </interface>
Nov 09 02:09:32 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:09:32 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/console.log" append="off"/>
Nov 09 02:09:32 user nova-compute[75438]:     </serial>
Nov 09 02:09:32 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:09:32 user nova-compute[75438]:     <video>
Nov 09 02:09:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:09:32 user nova-compute[75438]:     </video>
Nov 09 02:09:32 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:09:32 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:09:32 user nova-compute[75438]:     </rng>
Nov 09 02:09:32 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:09:32 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:09:32 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:09:32 user nova-compute[75438]:     </memballoon>
Nov 09 02:09:32 user nova-compute[75438]:   </devices>
Nov 09 02:09:32 user nova-compute[75438]: </domain>
Nov 09 02:09:32 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1933050020',display_name='tempest-ServerStableDeviceRescueTest-server-1933050020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1933050020',id=14,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKDpuWXe8laBaRb9YE1a4T307OlX9DrMSCdp2D+FiV3QrJsddtQiEFNfKYtruYEV/Te6PBx6sTuKx1fNq7XM5ic/fY3vZT/Ur/1hc/vA6eRDgpCFt7xwG0WlMZpFLqUvA==',key_name='tempest-keypair-1023383383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e41745ea4d9482b8bf124615afcf332',ramdisk_id='',reservation_id='r-ar1gm8na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1045361722',owner_user_name='tempest-ServerStableDeviceRescueTest-1045361722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d603c6cb567c414a9c1fef7259b0f124',uuid=f2c26e99-e089-49f5-9499-6bf035067512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converting VIF {"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG os_vif [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af31f6f9-ead2-5c23-9673-8f26e0466b31', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ab12034-c6, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ab12034-c6, col_values=(('qos', UUID('6f44324a-5303-4646-afd6-5ec6485fc219')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ab12034-c6, col_values=(('external_ids', {'iface-id': '3ab12034-c674-490a-be6d-db79cecc5b53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:5e:ef', 'vm-uuid': 'f2c26e99-e089-49f5-9499-6bf035067512'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:32 user nova-compute[75438]: INFO os_vif [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6')
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:09:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No VIF found with MAC fa:16:3e:7d:5e:ef, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updated VIF entry in instance network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-65a14b80-388b-4400-853a-9f33414dd9f0 req-29caa268-2319-49c7-b3a0-65a1abdd4ecc service nova] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23230623734613064', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230623734613064', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:09:33 user nova-compute[75438]:   <uuid>05bf2ae1-5578-4573-b0c7-9ce14999da93</uuid>
Nov 09 02:09:33 user nova-compute[75438]:   <name>instance-00000003</name>
Nov 09 02:09:33 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:09:33 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:09:33 user nova-compute[75438]:   <metadata>
Nov 09 02:09:33 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:09:33 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:09:33 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherB-server-900109230</nova:name>
Nov 09 02:09:33 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:09:31</nova:creationTime>
Nov 09 02:09:33 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:09:33 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:09:33 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:09:33 user nova-compute[75438]:       <nova:owner>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:user uuid="be52867f38a447129d9960106a2525f7">tempest-ServerActionsTestOtherB-1383355237-project-member</nova:user>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:project uuid="a20628afe4aa4c0aae9c883d4531cc74">tempest-ServerActionsTestOtherB-1383355237</nova:project>
Nov 09 02:09:33 user nova-compute[75438]:       </nova:owner>
Nov 09 02:09:33 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:09:33 user nova-compute[75438]:       <nova:ports>
Nov 09 02:09:33 user nova-compute[75438]:         <nova:port uuid="9c8b67f2-a61a-4580-85c9-ee3583275dc7">
Nov 09 02:09:33 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:09:33 user nova-compute[75438]:         </nova:port>
Nov 09 02:09:33 user nova-compute[75438]:       </nova:ports>
Nov 09 02:09:33 user nova-compute[75438]:     </nova:instance>
Nov 09 02:09:33 user nova-compute[75438]:   </metadata>
Nov 09 02:09:33 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:09:33 user nova-compute[75438]:     <system>
Nov 09 02:09:33 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:09:33 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:09:33 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:09:33 user nova-compute[75438]:       <entry name="serial">05bf2ae1-5578-4573-b0c7-9ce14999da93</entry>
Nov 09 02:09:33 user nova-compute[75438]:       <entry name="uuid">05bf2ae1-5578-4573-b0c7-9ce14999da93</entry>
Nov 09 02:09:33 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:09:33 user nova-compute[75438]:     </system>
Nov 09 02:09:33 user nova-compute[75438]:   </sysinfo>
Nov 09 02:09:33 user nova-compute[75438]:   <os>
Nov 09 02:09:33 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:09:33 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:09:33 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:09:33 user nova-compute[75438]:   </os>
Nov 09 02:09:33 user nova-compute[75438]:   <features>
Nov 09 02:09:33 user nova-compute[75438]:     <acpi/>
Nov 09 02:09:33 user nova-compute[75438]:     <apic/>
Nov 09 02:09:33 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:09:33 user nova-compute[75438]:   </features>
Nov 09 02:09:33 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:09:33 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:09:33 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:09:33 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:09:33 user nova-compute[75438]:   </clock>
Nov 09 02:09:33 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:09:33 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:09:33 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:09:33 user nova-compute[75438]:   </cpu>
Nov 09 02:09:33 user nova-compute[75438]:   <devices>
Nov 09 02:09:33 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:09:33 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:09:33 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk"/>
Nov 09 02:09:33 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:09:33 user nova-compute[75438]:     </disk>
Nov 09 02:09:33 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:09:33 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:09:33 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:09:33 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:09:33 user nova-compute[75438]:       <serial>12d5308d-cae3-4796-b701-cd59e18bf553</serial>
Nov 09 02:09:33 user nova-compute[75438]:     </disk>
Nov 09 02:09:33 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:09:33 user nova-compute[75438]:       <mac address="fa:16:3e:87:5b:eb"/>
Nov 09 02:09:33 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:09:33 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:09:33 user nova-compute[75438]:       <target dev="tap9c8b67f2-a6"/>
Nov 09 02:09:33 user nova-compute[75438]:     </interface>
Nov 09 02:09:33 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:09:33 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/console.log" append="off"/>
Nov 09 02:09:33 user nova-compute[75438]:     </serial>
Nov 09 02:09:33 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:09:33 user nova-compute[75438]:     <video>
Nov 09 02:09:33 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:09:33 user nova-compute[75438]:     </video>
Nov 09 02:09:33 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:09:33 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:09:33 user nova-compute[75438]:     </rng>
Nov 09 02:09:33 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:09:33 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:09:33 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:09:33 user nova-compute[75438]:     </memballoon>
Nov 09 02:09:33 user nova-compute[75438]:   </devices>
Nov 09 02:09:33 user nova-compute[75438]: </domain>
Nov 09 02:09:33 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:08:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG os_vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb851f68-c451-5f30-a0fd-4dee31133f26', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c8b67f2-a6, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c8b67f2-a6, col_values=(('qos', UUID('aff866be-503d-4615-92f7-dfe008799688')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c8b67f2-a6, col_values=(('external_ids', {'iface-id': '9c8b67f2-a61a-4580-85c9-ee3583275dc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5b:eb', 'vm-uuid': '05bf2ae1-5578-4573-b0c7-9ce14999da93'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:09:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:33 user nova-compute[75438]: INFO os_vif [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6')
Nov 09 02:09:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-82a194d5-9d72-4549-830e-64f75d4af235 req-7d1faa74-c822-460b-8155-93ae64f9cd98 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82a194d5-9d72-4549-830e-64f75d4af235 req-7d1faa74-c822-460b-8155-93ae64f9cd98 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82a194d5-9d72-4549-830e-64f75d4af235 req-7d1faa74-c822-460b-8155-93ae64f9cd98 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82a194d5-9d72-4549-830e-64f75d4af235 req-7d1faa74-c822-460b-8155-93ae64f9cd98 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-82a194d5-9d72-4549-830e-64f75d4af235 req-7d1faa74-c822-460b-8155-93ae64f9cd98 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:35 user nova-compute[75438]: WARNING nova.compute.manager [req-82a194d5-9d72-4549-830e-64f75d4af235 req-7d1faa74-c822-460b-8155-93ae64f9cd98 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state building and task_state spawning.
Nov 09 02:09:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-11c2e5c7-9614-46a4-a5e8-9a94410639ea req-0786ebfd-5e78-4434-8a13-f6c9b7fc2a93 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-11c2e5c7-9614-46a4-a5e8-9a94410639ea req-0786ebfd-5e78-4434-8a13-f6c9b7fc2a93 service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-11c2e5c7-9614-46a4-a5e8-9a94410639ea req-0786ebfd-5e78-4434-8a13-f6c9b7fc2a93 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-11c2e5c7-9614-46a4-a5e8-9a94410639ea req-0786ebfd-5e78-4434-8a13-f6c9b7fc2a93 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-11c2e5c7-9614-46a4-a5e8-9a94410639ea req-0786ebfd-5e78-4434-8a13-f6c9b7fc2a93 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:37 user nova-compute[75438]: WARNING nova.compute.manager [req-11c2e5c7-9614-46a4-a5e8-9a94410639ea req-0786ebfd-5e78-4434-8a13-f6c9b7fc2a93 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state resized and task_state resize_reverting.
Nov 09 02:09:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-25e52f1f-0c69-4814-9c3e-4cb616ad8498 req-a62bf83c-e8f5-429b-9a52-aaa425ac03e6 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-25e52f1f-0c69-4814-9c3e-4cb616ad8498 req-a62bf83c-e8f5-429b-9a52-aaa425ac03e6 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-25e52f1f-0c69-4814-9c3e-4cb616ad8498 req-a62bf83c-e8f5-429b-9a52-aaa425ac03e6 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-25e52f1f-0c69-4814-9c3e-4cb616ad8498 req-a62bf83c-e8f5-429b-9a52-aaa425ac03e6 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-25e52f1f-0c69-4814-9c3e-4cb616ad8498 req-a62bf83c-e8f5-429b-9a52-aaa425ac03e6 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:37 user nova-compute[75438]: WARNING nova.compute.manager [req-25e52f1f-0c69-4814-9c3e-4cb616ad8498 req-a62bf83c-e8f5-429b-9a52-aaa425ac03e6 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state building and task_state spawning.
Nov 09 02:09:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:09:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance spawned successfully.
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:09:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance running successfully.
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] finish_revert_migration finished successfully. {{(pid=75438) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:39 user nova-compute[75438]: INFO nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Took 10.40 seconds to spawn the instance on the hypervisor.
Nov 09 02:09:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:09:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-06602bbe-21fc-48b6-be64-7a8862230915 req-46fcdc48-72c9-44dd-8fb0-58042b09d08f service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06602bbe-21fc-48b6-be64-7a8862230915 req-46fcdc48-72c9-44dd-8fb0-58042b09d08f service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06602bbe-21fc-48b6-be64-7a8862230915 req-46fcdc48-72c9-44dd-8fb0-58042b09d08f service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-06602bbe-21fc-48b6-be64-7a8862230915 req-46fcdc48-72c9-44dd-8fb0-58042b09d08f service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-06602bbe-21fc-48b6-be64-7a8862230915 req-46fcdc48-72c9-44dd-8fb0-58042b09d08f service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:39 user nova-compute[75438]: WARNING nova.compute.manager [req-06602bbe-21fc-48b6-be64-7a8862230915 req-46fcdc48-72c9-44dd-8fb0-58042b09d08f service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state resized and task_state resize_reverting.
Nov 09 02:09:39 user nova-compute[75438]: INFO nova.compute.manager [None req-4738f2cb-8938-482c-97cd-ab863c11cb8a tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance to original state: 'active'
Nov 09 02:09:39 user nova-compute[75438]: INFO nova.compute.manager [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Took 11.34 seconds to build instance.
Nov 09 02:09:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56474511-2c1d-4c4d-b208-462c59161a98 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.462s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:09:43 user nova-compute[75438]: INFO nova.compute.claims [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Claim successful on node user
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.network.neutron [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:09:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.policy [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '866048ee57714ee7aae7be2a57102b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826e2b5db9464d15aa10f4f889e9d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:09:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Creating image(s)
Nov 09 02:09:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "/opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "/opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.226s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk 1073741824" returned: 0 in 0.066s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Cannot resize image /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Ensure instance console log exists: /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:45 user nova-compute[75438]: DEBUG nova.network.neutron [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Successfully created port: 28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Successfully updated port: 28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquired lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-changed-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Refreshing instance network info cache due to event network-changed-28474d81-f7a1-4202-a5c1-d6a169cf3675. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] Acquiring lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updating instance_info_cache with network_info: [{"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Releasing lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Instance network_info: |[{"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] Acquired lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Refreshing network info cache for port 28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Start _get_guest_xml network_info=[{"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:09:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:09:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2145925525',display_name='tempest-VolumesAdminNegativeTest-server-2145925525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2145925525',id=15,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+zViIsxWnnpzbSaGsWjReo8dFD6pMuBgCLBh94roUbkmvl6oNcmWlcWfFijchjK/DxMvX6xlyNusZR4a/Zjk65rYsL+qxVsqrCaoZH4Q0q0f2MrKeQUO+dAr8hVDNjBw==',key_name='tempest-keypair-877285507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e2b5db9464d15aa10f4f889e9d320',ramdisk_id='',reservation_id='r-vd0p0t9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1041878911',owner_user_name='tempest-VolumesAdminNegativeTest-1041878911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='866048ee57714ee7aae7be2a57102b0a',uuid=bb481848-5207-4f0b-b56e-8a48bde425f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converting VIF {"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.objects.instance [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'pci_devices' on Instance uuid bb481848-5207-4f0b-b56e-8a48bde425f8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:09:47 user nova-compute[75438]:   <uuid>bb481848-5207-4f0b-b56e-8a48bde425f8</uuid>
Nov 09 02:09:47 user nova-compute[75438]:   <name>instance-0000000f</name>
Nov 09 02:09:47 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:09:47 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:09:47 user nova-compute[75438]:   <metadata>
Nov 09 02:09:47 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:09:47 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:09:47 user nova-compute[75438]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2145925525</nova:name>
Nov 09 02:09:47 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:09:46</nova:creationTime>
Nov 09 02:09:47 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:09:47 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:09:47 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:09:47 user nova-compute[75438]:       <nova:owner>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:user uuid="866048ee57714ee7aae7be2a57102b0a">tempest-VolumesAdminNegativeTest-1041878911-project-member</nova:user>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:project uuid="826e2b5db9464d15aa10f4f889e9d320">tempest-VolumesAdminNegativeTest-1041878911</nova:project>
Nov 09 02:09:47 user nova-compute[75438]:       </nova:owner>
Nov 09 02:09:47 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:09:47 user nova-compute[75438]:       <nova:ports>
Nov 09 02:09:47 user nova-compute[75438]:         <nova:port uuid="28474d81-f7a1-4202-a5c1-d6a169cf3675">
Nov 09 02:09:47 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:09:47 user nova-compute[75438]:         </nova:port>
Nov 09 02:09:47 user nova-compute[75438]:       </nova:ports>
Nov 09 02:09:47 user nova-compute[75438]:     </nova:instance>
Nov 09 02:09:47 user nova-compute[75438]:   </metadata>
Nov 09 02:09:47 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:09:47 user nova-compute[75438]:     <system>
Nov 09 02:09:47 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:09:47 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:09:47 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:09:47 user nova-compute[75438]:       <entry name="serial">bb481848-5207-4f0b-b56e-8a48bde425f8</entry>
Nov 09 02:09:47 user nova-compute[75438]:       <entry name="uuid">bb481848-5207-4f0b-b56e-8a48bde425f8</entry>
Nov 09 02:09:47 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:09:47 user nova-compute[75438]:     </system>
Nov 09 02:09:47 user nova-compute[75438]:   </sysinfo>
Nov 09 02:09:47 user nova-compute[75438]:   <os>
Nov 09 02:09:47 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:09:47 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:09:47 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:09:47 user nova-compute[75438]:   </os>
Nov 09 02:09:47 user nova-compute[75438]:   <features>
Nov 09 02:09:47 user nova-compute[75438]:     <acpi/>
Nov 09 02:09:47 user nova-compute[75438]:     <apic/>
Nov 09 02:09:47 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:09:47 user nova-compute[75438]:   </features>
Nov 09 02:09:47 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:09:47 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:09:47 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:09:47 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:09:47 user nova-compute[75438]:   </clock>
Nov 09 02:09:47 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:09:47 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:09:47 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:09:47 user nova-compute[75438]:   </cpu>
Nov 09 02:09:47 user nova-compute[75438]:   <devices>
Nov 09 02:09:47 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:09:47 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:09:47 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk"/>
Nov 09 02:09:47 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:09:47 user nova-compute[75438]:     </disk>
Nov 09 02:09:47 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:09:47 user nova-compute[75438]:       <mac address="fa:16:3e:cd:9d:59"/>
Nov 09 02:09:47 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:09:47 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:09:47 user nova-compute[75438]:       <target dev="tap28474d81-f7"/>
Nov 09 02:09:47 user nova-compute[75438]:     </interface>
Nov 09 02:09:47 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:09:47 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/console.log" append="off"/>
Nov 09 02:09:47 user nova-compute[75438]:     </serial>
Nov 09 02:09:47 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:09:47 user nova-compute[75438]:     <video>
Nov 09 02:09:47 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:09:47 user nova-compute[75438]:     </video>
Nov 09 02:09:47 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:09:47 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:09:47 user nova-compute[75438]:     </rng>
Nov 09 02:09:47 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:09:47 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:09:47 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:09:47 user nova-compute[75438]:     </memballoon>
Nov 09 02:09:47 user nova-compute[75438]:   </devices>
Nov 09 02:09:47 user nova-compute[75438]: </domain>
Nov 09 02:09:47 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2145925525',display_name='tempest-VolumesAdminNegativeTest-server-2145925525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2145925525',id=15,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+zViIsxWnnpzbSaGsWjReo8dFD6pMuBgCLBh94roUbkmvl6oNcmWlcWfFijchjK/DxMvX6xlyNusZR4a/Zjk65rYsL+qxVsqrCaoZH4Q0q0f2MrKeQUO+dAr8hVDNjBw==',key_name='tempest-keypair-877285507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e2b5db9464d15aa10f4f889e9d320',ramdisk_id='',reservation_id='r-vd0p0t9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1041878911',owner_user_name='tempest-VolumesAdminNegativeTest-1041878911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='866048ee57714ee7aae7be2a57102b0a',uuid=bb481848-5207-4f0b-b56e-8a48bde425f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converting VIF {"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG os_vif [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7456d44f-12bf-56fe-9d08-898ee6845fc6', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28474d81-f7, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28474d81-f7, col_values=(('qos', UUID('bccac30f-d29b-4f13-bc59-033f1f84a0c2')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28474d81-f7, col_values=(('external_ids', {'iface-id': '28474d81-f7a1-4202-a5c1-d6a169cf3675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:9d:59', 'vm-uuid': 'bb481848-5207-4f0b-b56e-8a48bde425f8'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:47 user nova-compute[75438]: INFO os_vif [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7')
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No VIF found with MAC fa:16:3e:cd:9d:59, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updated VIF entry in instance network info cache for port 28474d81-f7a1-4202-a5c1-d6a169cf3675. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updating instance_info_cache with network_info: [{"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:09:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5d0bfd5c-c3b4-4ee3-a0a1-c3c96ef3ef17 req-37a80f34-8940-466b-89e5-e897bbbe74d5 service nova] Releasing lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-de500b65-4235-484f-8f28-9aa72eefb0bd req-1db57a5e-e35d-4fdc-8be2-61c316b99ac1 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-de500b65-4235-484f-8f28-9aa72eefb0bd req-1db57a5e-e35d-4fdc-8be2-61c316b99ac1 service nova] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-de500b65-4235-484f-8f28-9aa72eefb0bd req-1db57a5e-e35d-4fdc-8be2-61c316b99ac1 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-de500b65-4235-484f-8f28-9aa72eefb0bd req-1db57a5e-e35d-4fdc-8be2-61c316b99ac1 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-de500b65-4235-484f-8f28-9aa72eefb0bd req-1db57a5e-e35d-4fdc-8be2-61c316b99ac1 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] No waiting events found dispatching network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:48 user nova-compute[75438]: WARNING nova.compute.manager [req-de500b65-4235-484f-8f28-9aa72eefb0bd req-1db57a5e-e35d-4fdc-8be2-61c316b99ac1 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received unexpected event network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 for instance with vm_state building and task_state spawning.
Nov 09 02:09:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b6b77812-7893-468e-b2b9-90ed9ac33a7b req-c3398009-dadf-4194-81b1-5bafa73d4f87 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:09:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b77812-7893-468e-b2b9-90ed9ac33a7b req-c3398009-dadf-4194-81b1-5bafa73d4f87 service nova] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b77812-7893-468e-b2b9-90ed9ac33a7b req-c3398009-dadf-4194-81b1-5bafa73d4f87 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b6b77812-7893-468e-b2b9-90ed9ac33a7b req-c3398009-dadf-4194-81b1-5bafa73d4f87 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b6b77812-7893-468e-b2b9-90ed9ac33a7b req-c3398009-dadf-4194-81b1-5bafa73d4f87 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] No waiting events found dispatching network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:09:50 user nova-compute[75438]: WARNING nova.compute.manager [req-b6b77812-7893-468e-b2b9-90ed9ac33a7b req-c3398009-dadf-4194-81b1-5bafa73d4f87 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received unexpected event network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 for instance with vm_state building and task_state spawning.
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:09:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Instance spawned successfully.
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:09:51 user nova-compute[75438]: INFO nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 09 02:09:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:09:51 user nova-compute[75438]: INFO nova.compute.manager [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Took 7.56 seconds to build instance.
Nov 09 02:09:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-71bd4056-941e-47b0-ad67-ee713056b742 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.749s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:09:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:09:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:09:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:09:58 user nova-compute[75438]: INFO nova.compute.manager [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Detaching volume ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:09:58 user nova-compute[75438]: INFO nova.virt.block_device [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Attempting to driver detach volume ea000b0d-4862-4303-8e98-5e99b87a7bc2 from mountpoint /dev/vdb
Nov 09 02:09:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Attempting to detach device vdb from instance a300e943-2854-4f88-97b1-8d2e2b754f12 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:09:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:09:58 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:09:58 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:09:58 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:09:58 user nova-compute[75438]:   <serial>ea000b0d-4862-4303-8e98-5e99b87a7bc2</serial>
Nov 09 02:09:58 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:09:58 user nova-compute[75438]: </disk>
Nov 09 02:09:58 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:09:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully detached device vdb from instance a300e943-2854-4f88-97b1-8d2e2b754f12 from the persistent domain config.
Nov 09 02:09:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a300e943-2854-4f88-97b1-8d2e2b754f12 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:09:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:09:58 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:09:58 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:09:58 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:09:58 user nova-compute[75438]:   <serial>ea000b0d-4862-4303-8e98-5e99b87a7bc2</serial>
Nov 09 02:09:58 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:09:58 user nova-compute[75438]: </disk>
Nov 09 02:09:58 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:09:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:10:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:19 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a300e943-2854-4f88-97b1-8d2e2b754f12 is timed out.
Nov 09 02:10:19 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully detached device vdb from instance a300e943-2854-4f88-97b1-8d2e2b754f12 from the live domain config.
Nov 09 02:10:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQhSrqmJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:10:19 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb5e537-ca75-42be-a9a6-82b2a6c5a0b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:10:19 user nova-compute[75438]: No targets found.
Nov 09 02:10:19 user nova-compute[75438]: iSNS:
Nov 09 02:10:19 user nova-compute[75438]: No targets found.
Nov 09 02:10:19 user nova-compute[75438]: STATIC:
Nov 09 02:10:19 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:10:19 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:10:19 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:10:19 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2
Nov 09 02:10:19 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:10:19 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:10:19 user nova-compute[75438]: FIRMWARE:
Nov 09 02:10:19 user nova-compute[75438]: No targets found.
Nov 09 02:10:19 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:10:19 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:10:19 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea83821-9812-4d27-8dde-bcdd54f417bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2160c0c3-6c09-4e04-abf5-b6f01a376653]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:10:19 user nova-compute[75438]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:10:19 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 (non-flash)
Nov 09 02:10:19 user nova-compute[75438]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:10:19 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba045cc700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ec4cc3-208f-4905-a192-f84020f163eb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a96d7-c67b-4de2-b9d5-31fc1a8bad4d]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e6d7b2-6a2c-46c5-ae17-818903a89500]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf85350a-23ee-4920-9da6-aad2a86bc9b3]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db7bfe-a5a9-41e1-ab0f-a1d9edfff2f8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145db7c-1c86-4c0a-95f8-bc10894361aa]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260]
Nov 09 02:10:19 user nova-compute[75438]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2, portal: 172.16.0.220,3260] successful.
Nov 09 02:10:19 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea000b0d-4862-4303-8e98-5e99b87a7bc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f6b01b-bf2a-4353-8263-eb4a4a17ed4b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== disconnect_volume: return (349ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:10:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:10:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:10:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:22 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:22 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:10:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:27 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:10:27 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=25.328041076660156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:10:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:10:28 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:10:29 user nova-compute[75438]: INFO nova.compute.claims [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Claim successful on node user
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.objects.instance [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-56ca5c52-9294-4ac8-929e-b6d45dca534d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.949s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.network.neutron [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:10:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.policy [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '173f61ba6555421b8f09a996aee60807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44c6747d124716b0bcab5f94ac82f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:10:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Creating image(s)
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "/opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "/opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk 1073741824" returned: 0 in 0.077s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75438) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Successfully created port: 241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.238s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Cannot resize image /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Ensure instance console log exists: /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-9b748cb0-6494-4a62-a54f-eb6ad606fa76 req-beb778ae-ad1f-48a7-9d36-9ec493df6734 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b748cb0-6494-4a62-a54f-eb6ad606fa76 req-beb778ae-ad1f-48a7-9d36-9ec493df6734 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b748cb0-6494-4a62-a54f-eb6ad606fa76 req-beb778ae-ad1f-48a7-9d36-9ec493df6734 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b748cb0-6494-4a62-a54f-eb6ad606fa76 req-beb778ae-ad1f-48a7-9d36-9ec493df6734 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-9b748cb0-6494-4a62-a54f-eb6ad606fa76 req-beb778ae-ad1f-48a7-9d36-9ec493df6734 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:10:30 user nova-compute[75438]: WARNING nova.compute.manager [req-9b748cb0-6494-4a62-a54f-eb6ad606fa76 req-beb778ae-ad1f-48a7-9d36-9ec493df6734 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state active and task_state powering-off.
Nov 09 02:10:31 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance destroyed successfully.
Nov 09 02:10:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:10:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7cddcc21-5fdc-4c4d-8ec1-129e07a89b81 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.060s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Successfully updated port: 241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:10:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "refresh_cache-c2f689e5-afcc-4043-8ac1-3ff999a702da" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:10:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquired lock "refresh_cache-c2f689e5-afcc-4043-8ac1-3ff999a702da" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:10:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:10:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Updating instance_info_cache with network_info: [{"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Releasing lock "refresh_cache-c2f689e5-afcc-4043-8ac1-3ff999a702da" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Instance network_info: |[{"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Start _get_guest_xml network_info=[{"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:10:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:10:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-781804938',display_name='tempest-ServersNegativeTestJSON-server-781804938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-781804938',id=16,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a44c6747d124716b0bcab5f94ac82f1',ramdisk_id='',reservation_id='r-uk60jkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1310159943',owner_user_name='tempest-ServersNegativeTestJSON-1310159943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:10:30Z,user_data=None,user_id='173f61ba6555421b8f09a996aee60807',uuid=c2f689e5-afcc-4043-8ac1-3ff999a702da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converting VIF {"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lazy-loading 'pci_devices' on Instance uuid c2f689e5-afcc-4043-8ac1-3ff999a702da {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:10:32 user nova-compute[75438]:   <uuid>c2f689e5-afcc-4043-8ac1-3ff999a702da</uuid>
Nov 09 02:10:32 user nova-compute[75438]:   <name>instance-00000010</name>
Nov 09 02:10:32 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:10:32 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:10:32 user nova-compute[75438]:   <metadata>
Nov 09 02:10:32 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:10:32 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:10:32 user nova-compute[75438]:       <nova:name>tempest-ServersNegativeTestJSON-server-781804938</nova:name>
Nov 09 02:10:32 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:10:32</nova:creationTime>
Nov 09 02:10:32 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:10:32 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:10:32 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:10:32 user nova-compute[75438]:       <nova:owner>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:user uuid="173f61ba6555421b8f09a996aee60807">tempest-ServersNegativeTestJSON-1310159943-project-member</nova:user>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:project uuid="8a44c6747d124716b0bcab5f94ac82f1">tempest-ServersNegativeTestJSON-1310159943</nova:project>
Nov 09 02:10:32 user nova-compute[75438]:       </nova:owner>
Nov 09 02:10:32 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:10:32 user nova-compute[75438]:       <nova:ports>
Nov 09 02:10:32 user nova-compute[75438]:         <nova:port uuid="241428c7-57f9-41a3-9632-41f218a5ad3d">
Nov 09 02:10:32 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:10:32 user nova-compute[75438]:         </nova:port>
Nov 09 02:10:32 user nova-compute[75438]:       </nova:ports>
Nov 09 02:10:32 user nova-compute[75438]:     </nova:instance>
Nov 09 02:10:32 user nova-compute[75438]:   </metadata>
Nov 09 02:10:32 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:10:32 user nova-compute[75438]:     <system>
Nov 09 02:10:32 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:10:32 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:10:32 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:10:32 user nova-compute[75438]:       <entry name="serial">c2f689e5-afcc-4043-8ac1-3ff999a702da</entry>
Nov 09 02:10:32 user nova-compute[75438]:       <entry name="uuid">c2f689e5-afcc-4043-8ac1-3ff999a702da</entry>
Nov 09 02:10:32 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:10:32 user nova-compute[75438]:     </system>
Nov 09 02:10:32 user nova-compute[75438]:   </sysinfo>
Nov 09 02:10:32 user nova-compute[75438]:   <os>
Nov 09 02:10:32 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:10:32 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:10:32 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:10:32 user nova-compute[75438]:   </os>
Nov 09 02:10:32 user nova-compute[75438]:   <features>
Nov 09 02:10:32 user nova-compute[75438]:     <acpi/>
Nov 09 02:10:32 user nova-compute[75438]:     <apic/>
Nov 09 02:10:32 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:10:32 user nova-compute[75438]:   </features>
Nov 09 02:10:32 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:10:32 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:10:32 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:10:32 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:10:32 user nova-compute[75438]:   </clock>
Nov 09 02:10:32 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:10:32 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:10:32 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:10:32 user nova-compute[75438]:   </cpu>
Nov 09 02:10:32 user nova-compute[75438]:   <devices>
Nov 09 02:10:32 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:10:32 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:10:32 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk"/>
Nov 09 02:10:32 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:10:32 user nova-compute[75438]:     </disk>
Nov 09 02:10:32 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:10:32 user nova-compute[75438]:       <mac address="fa:16:3e:8c:96:e3"/>
Nov 09 02:10:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:10:32 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:10:32 user nova-compute[75438]:       <target dev="tap241428c7-57"/>
Nov 09 02:10:32 user nova-compute[75438]:     </interface>
Nov 09 02:10:32 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:10:32 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/console.log" append="off"/>
Nov 09 02:10:32 user nova-compute[75438]:     </serial>
Nov 09 02:10:32 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:10:32 user nova-compute[75438]:     <video>
Nov 09 02:10:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:10:32 user nova-compute[75438]:     </video>
Nov 09 02:10:32 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:10:32 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:10:32 user nova-compute[75438]:     </rng>
Nov 09 02:10:32 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:10:32 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:10:32 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:10:32 user nova-compute[75438]:     </memballoon>
Nov 09 02:10:32 user nova-compute[75438]:   </devices>
Nov 09 02:10:32 user nova-compute[75438]: </domain>
Nov 09 02:10:32 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-781804938',display_name='tempest-ServersNegativeTestJSON-server-781804938',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-781804938',id=16,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a44c6747d124716b0bcab5f94ac82f1',ramdisk_id='',reservation_id='r-uk60jkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1310159943',owner_user_name='tempest-ServersNegativeTestJSON-1310159943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:10:30Z,user_data=None,user_id='173f61ba6555421b8f09a996aee60807',uuid=c2f689e5-afcc-4043-8ac1-3ff999a702da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converting VIF {"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG os_vif [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18f9cf5e-c123-51f9-8e32-4a4d69020a57', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap241428c7-57, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap241428c7-57, col_values=(('qos', UUID('ef612f95-68fe-4dbe-8228-205092b8c5b2')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap241428c7-57, col_values=(('external_ids', {'iface-id': '241428c7-57f9-41a3-9632-41f218a5ad3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:96:e3', 'vm-uuid': 'c2f689e5-afcc-4043-8ac1-3ff999a702da'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:32 user nova-compute[75438]: INFO os_vif [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57')
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:10:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] No VIF found with MAC fa:16:3e:8c:96:e3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:10:33 user nova-compute[75438]: WARNING nova.compute.manager [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state stopped and task_state None.
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-changed-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Refreshing instance network info cache due to event network-changed-241428c7-57f9-41a3-9632-41f218a5ad3d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] Acquiring lock "refresh_cache-c2f689e5-afcc-4043-8ac1-3ff999a702da" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] Acquired lock "refresh_cache-c2f689e5-afcc-4043-8ac1-3ff999a702da" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Refreshing network info cache for port 241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Updated VIF entry in instance network info cache for port 241428c7-57f9-41a3-9632-41f218a5ad3d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Updating instance_info_cache with network_info: [{"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad859645-fb41-4efe-90eb-488285a7d59a req-c0e857e3-4c09-4717-9ba4-f711a69205f4 service nova] Releasing lock "refresh_cache-c2f689e5-afcc-4043-8ac1-3ff999a702da" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c483ac7-dbcc-4f80-b66d-bbd6c95c00d8 req-ffa37bb1-df4d-40d9-80fe-0af5e4808c6e service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c483ac7-dbcc-4f80-b66d-bbd6c95c00d8 req-ffa37bb1-df4d-40d9-80fe-0af5e4808c6e service nova] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c483ac7-dbcc-4f80-b66d-bbd6c95c00d8 req-ffa37bb1-df4d-40d9-80fe-0af5e4808c6e service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c483ac7-dbcc-4f80-b66d-bbd6c95c00d8 req-ffa37bb1-df4d-40d9-80fe-0af5e4808c6e service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c483ac7-dbcc-4f80-b66d-bbd6c95c00d8 req-ffa37bb1-df4d-40d9-80fe-0af5e4808c6e service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] No waiting events found dispatching network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:10:34 user nova-compute[75438]: WARNING nova.compute.manager [req-5c483ac7-dbcc-4f80-b66d-bbd6c95c00d8 req-ffa37bb1-df4d-40d9-80fe-0af5e4808c6e service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received unexpected event network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d for instance with vm_state building and task_state spawning.
Nov 09 02:10:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-bc56efaa-9196-499f-a227-1e9e003f7d5d req-b821db12-2155-4ccc-a964-11dcf9933992 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc56efaa-9196-499f-a227-1e9e003f7d5d req-b821db12-2155-4ccc-a964-11dcf9933992 service nova] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc56efaa-9196-499f-a227-1e9e003f7d5d req-b821db12-2155-4ccc-a964-11dcf9933992 service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc56efaa-9196-499f-a227-1e9e003f7d5d req-b821db12-2155-4ccc-a964-11dcf9933992 service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-bc56efaa-9196-499f-a227-1e9e003f7d5d req-b821db12-2155-4ccc-a964-11dcf9933992 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] No waiting events found dispatching network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:10:36 user nova-compute[75438]: WARNING nova.compute.manager [req-bc56efaa-9196-499f-a227-1e9e003f7d5d req-b821db12-2155-4ccc-a964-11dcf9933992 service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received unexpected event network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d for instance with vm_state building and task_state spawning.
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:10:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Instance spawned successfully.
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:10:36 user nova-compute[75438]: INFO nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 09 02:10:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:10:36 user nova-compute[75438]: INFO nova.compute.manager [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Took 7.57 seconds to build instance.
Nov 09 02:10:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-87d269d3-496f-47c3-b5db-9ef167ab3230 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.749s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-changed-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Refreshing instance network info cache due to event network-changed-cca4d3f1-d39a-4163-aa83-b0df831b92cb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG nova.network.neutron [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Refreshing network info cache for port cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG nova.network.neutron [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updated VIF entry in instance network info cache for port cca4d3f1-d39a-4163-aa83-b0df831b92cb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG nova.network.neutron [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:10:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6cb7a493-155f-4323-a0b8-c9809c909c29 req-6a04f576-ca39-4216-80b5-62a915e7fc71 service nova] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:10:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:10:54 user nova-compute[75438]: INFO nova.compute.claims [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Claim successful on node user
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:10:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:10:54 user nova-compute[75438]: DEBUG nova.policy [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3160dcb696a24d3db8bd3a22064cbd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d490c388e64d5fbdeec47eb532482e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:10:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Creating image(s)
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.214s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk 1073741824" returned: 0 in 0.071s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Successfully created port: 6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Cannot resize image /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Successfully updated port: 6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-changed-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Refreshing instance network info cache due to event network-changed-6ed89336-3495-4c32-b2c6-70bff90e6b21. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] Acquiring lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Instance network_info: |[{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] Acquired lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.network.neutron [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Refreshing network info cache for port 6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Start _get_guest_xml network_info=[{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:10:56 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:10:56 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:10:56 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205438585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-205438585',id=17,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-930epdk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:10:55Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=7d8acf4e-7bc3-4302-8966-326bcc45ebf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:10:57 user nova-compute[75438]:   <uuid>7d8acf4e-7bc3-4302-8966-326bcc45ebf7</uuid>
Nov 09 02:10:57 user nova-compute[75438]:   <name>instance-00000011</name>
Nov 09 02:10:57 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:10:57 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:10:57 user nova-compute[75438]:   <metadata>
Nov 09 02:10:57 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:10:57 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:10:57 user nova-compute[75438]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-205438585</nova:name>
Nov 09 02:10:57 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:10:56</nova:creationTime>
Nov 09 02:10:57 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:10:57 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:10:57 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:10:57 user nova-compute[75438]:       <nova:owner>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:user uuid="3160dcb696a24d3db8bd3a22064cbd7a">tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member</nova:user>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:project uuid="f7d490c388e64d5fbdeec47eb532482e">tempest-ServerBootFromVolumeStableRescueTest-1794136160</nova:project>
Nov 09 02:10:57 user nova-compute[75438]:       </nova:owner>
Nov 09 02:10:57 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:10:57 user nova-compute[75438]:       <nova:ports>
Nov 09 02:10:57 user nova-compute[75438]:         <nova:port uuid="6ed89336-3495-4c32-b2c6-70bff90e6b21">
Nov 09 02:10:57 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:10:57 user nova-compute[75438]:         </nova:port>
Nov 09 02:10:57 user nova-compute[75438]:       </nova:ports>
Nov 09 02:10:57 user nova-compute[75438]:     </nova:instance>
Nov 09 02:10:57 user nova-compute[75438]:   </metadata>
Nov 09 02:10:57 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:10:57 user nova-compute[75438]:     <system>
Nov 09 02:10:57 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:10:57 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:10:57 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:10:57 user nova-compute[75438]:       <entry name="serial">7d8acf4e-7bc3-4302-8966-326bcc45ebf7</entry>
Nov 09 02:10:57 user nova-compute[75438]:       <entry name="uuid">7d8acf4e-7bc3-4302-8966-326bcc45ebf7</entry>
Nov 09 02:10:57 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:10:57 user nova-compute[75438]:     </system>
Nov 09 02:10:57 user nova-compute[75438]:   </sysinfo>
Nov 09 02:10:57 user nova-compute[75438]:   <os>
Nov 09 02:10:57 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:10:57 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:10:57 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:10:57 user nova-compute[75438]:   </os>
Nov 09 02:10:57 user nova-compute[75438]:   <features>
Nov 09 02:10:57 user nova-compute[75438]:     <acpi/>
Nov 09 02:10:57 user nova-compute[75438]:     <apic/>
Nov 09 02:10:57 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:10:57 user nova-compute[75438]:   </features>
Nov 09 02:10:57 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:10:57 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:10:57 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:10:57 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:10:57 user nova-compute[75438]:   </clock>
Nov 09 02:10:57 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:10:57 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:10:57 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:10:57 user nova-compute[75438]:   </cpu>
Nov 09 02:10:57 user nova-compute[75438]:   <devices>
Nov 09 02:10:57 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:10:57 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:10:57 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk"/>
Nov 09 02:10:57 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:10:57 user nova-compute[75438]:     </disk>
Nov 09 02:10:57 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:10:57 user nova-compute[75438]:       <mac address="fa:16:3e:e5:c1:1b"/>
Nov 09 02:10:57 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:10:57 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:10:57 user nova-compute[75438]:       <target dev="tap6ed89336-34"/>
Nov 09 02:10:57 user nova-compute[75438]:     </interface>
Nov 09 02:10:57 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:10:57 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/console.log" append="off"/>
Nov 09 02:10:57 user nova-compute[75438]:     </serial>
Nov 09 02:10:57 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:10:57 user nova-compute[75438]:     <video>
Nov 09 02:10:57 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:10:57 user nova-compute[75438]:     </video>
Nov 09 02:10:57 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:10:57 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:10:57 user nova-compute[75438]:     </rng>
Nov 09 02:10:57 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:10:57 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:10:57 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:10:57 user nova-compute[75438]:     </memballoon>
Nov 09 02:10:57 user nova-compute[75438]:   </devices>
Nov 09 02:10:57 user nova-compute[75438]: </domain>
Nov 09 02:10:57 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205438585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-205438585',id=17,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-930epdk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:10:55Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=7d8acf4e-7bc3-4302-8966-326bcc45ebf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG os_vif [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9196c405-adae-5e3f-9d07-04689e7d811c', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed89336-34, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ed89336-34, col_values=(('qos', UUID('b6dfb0a7-793e-4cd1-8b3e-a1a4af1426ab')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ed89336-34, col_values=(('external_ids', {'iface-id': '6ed89336-3495-4c32-b2c6-70bff90e6b21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:c1:1b', 'vm-uuid': '7d8acf4e-7bc3-4302-8966-326bcc45ebf7'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:57 user nova-compute[75438]: INFO os_vif [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34')
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No VIF found with MAC fa:16:3e:e5:c1:1b, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.network.neutron [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updated VIF entry in instance network info cache for port 6ed89336-3495-4c32-b2c6-70bff90e6b21. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG nova.network.neutron [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:10:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-810db39f-32b6-42a7-b1a7-c8fea8e51ac6 req-0bb9867a-b6f6-41de-89bd-dc40582b51b5 service nova] Releasing lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:10:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5c9356f-afd3-4f8a-b880-8aa7633e784a req-73198daf-7f5c-4028-85ee-3197adc94507 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5c9356f-afd3-4f8a-b880-8aa7633e784a req-73198daf-7f5c-4028-85ee-3197adc94507 service nova] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5c9356f-afd3-4f8a-b880-8aa7633e784a req-73198daf-7f5c-4028-85ee-3197adc94507 service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f5c9356f-afd3-4f8a-b880-8aa7633e784a req-73198daf-7f5c-4028-85ee-3197adc94507 service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-f5c9356f-afd3-4f8a-b880-8aa7633e784a req-73198daf-7f5c-4028-85ee-3197adc94507 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] No waiting events found dispatching network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:10:59 user nova-compute[75438]: WARNING nova.compute.manager [req-f5c9356f-afd3-4f8a-b880-8aa7633e784a req-73198daf-7f5c-4028-85ee-3197adc94507 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received unexpected event network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 for instance with vm_state building and task_state spawning.
Nov 09 02:10:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:10:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:11:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:11:00 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Instance spawned successfully.
Nov 09 02:11:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:01 user nova-compute[75438]: INFO nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-86ef2051-24a6-4af7-a1e1-a981476fc9da req-f255ab90-995a-4ea2-9ba1-b4e1bb204b5c service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-86ef2051-24a6-4af7-a1e1-a981476fc9da req-f255ab90-995a-4ea2-9ba1-b4e1bb204b5c service nova] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-86ef2051-24a6-4af7-a1e1-a981476fc9da req-f255ab90-995a-4ea2-9ba1-b4e1bb204b5c service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-86ef2051-24a6-4af7-a1e1-a981476fc9da req-f255ab90-995a-4ea2-9ba1-b4e1bb204b5c service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-86ef2051-24a6-4af7-a1e1-a981476fc9da req-f255ab90-995a-4ea2-9ba1-b4e1bb204b5c service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] No waiting events found dispatching network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:11:01 user nova-compute[75438]: WARNING nova.compute.manager [req-86ef2051-24a6-4af7-a1e1-a981476fc9da req-f255ab90-995a-4ea2-9ba1-b4e1bb204b5c service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received unexpected event network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 for instance with vm_state building and task_state spawning.
Nov 09 02:11:01 user nova-compute[75438]: INFO nova.compute.manager [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Took 6.94 seconds to build instance.
Nov 09 02:11:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c82b14f7-9a6b-4ab8-90fa-b77a2f5d5c62 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.056s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:11:15 user nova-compute[75438]: INFO nova.compute.claims [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Claim successful on node user
Nov 09 02:11:15 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:11:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.policy [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab1818da0f7a44fe8ae3f9ffce360386', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bdfa4af42b4c9796dd143f0c4c3da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:11:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Creating image(s)
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk 1073741824" returned: 0 in 0.054s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:11:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Cannot resize image /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Ensure instance console log exists: /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Successfully created port: e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Successfully updated port: e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing instance network info cache due to event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:11:17 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance network_info: |[{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.neutron [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Start _get_guest_xml network_info=[{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:11:18 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:11:18 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2017582046',display_name='tempest-ServerRescueNegativeTestJSON-server-2017582046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2017582046',id=18,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1p/3B+c15jCLdpAkQLerArcyvJcCFaICTi+O31TuA5oQKNx0JzlTlHURY+pMWgl/LUvKYUWiZueWxJGQ7iMmyKEKvZxPV5oIJyvUy79GVwlsEBGGVkupiWcyov7Dv4ng==',key_name='tempest-keypair-544213512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-jtr2iw2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:11:18 user nova-compute[75438]:   <uuid>7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d</uuid>
Nov 09 02:11:18 user nova-compute[75438]:   <name>instance-00000012</name>
Nov 09 02:11:18 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:11:18 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:11:18 user nova-compute[75438]:   <metadata>
Nov 09 02:11:18 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:11:18 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:11:18 user nova-compute[75438]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2017582046</nova:name>
Nov 09 02:11:18 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:11:18</nova:creationTime>
Nov 09 02:11:18 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:11:18 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:11:18 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:11:18 user nova-compute[75438]:       <nova:owner>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:user uuid="ab1818da0f7a44fe8ae3f9ffce360386">tempest-ServerRescueNegativeTestJSON-655487496-project-member</nova:user>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:project uuid="92bdfa4af42b4c9796dd143f0c4c3da1">tempest-ServerRescueNegativeTestJSON-655487496</nova:project>
Nov 09 02:11:18 user nova-compute[75438]:       </nova:owner>
Nov 09 02:11:18 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:11:18 user nova-compute[75438]:       <nova:ports>
Nov 09 02:11:18 user nova-compute[75438]:         <nova:port uuid="e62b5ee2-b006-48b2-a038-94869d96fc8a">
Nov 09 02:11:18 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:11:18 user nova-compute[75438]:         </nova:port>
Nov 09 02:11:18 user nova-compute[75438]:       </nova:ports>
Nov 09 02:11:18 user nova-compute[75438]:     </nova:instance>
Nov 09 02:11:18 user nova-compute[75438]:   </metadata>
Nov 09 02:11:18 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:11:18 user nova-compute[75438]:     <system>
Nov 09 02:11:18 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:11:18 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:11:18 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:11:18 user nova-compute[75438]:       <entry name="serial">7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d</entry>
Nov 09 02:11:18 user nova-compute[75438]:       <entry name="uuid">7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d</entry>
Nov 09 02:11:18 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:11:18 user nova-compute[75438]:     </system>
Nov 09 02:11:18 user nova-compute[75438]:   </sysinfo>
Nov 09 02:11:18 user nova-compute[75438]:   <os>
Nov 09 02:11:18 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:11:18 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:11:18 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:11:18 user nova-compute[75438]:   </os>
Nov 09 02:11:18 user nova-compute[75438]:   <features>
Nov 09 02:11:18 user nova-compute[75438]:     <acpi/>
Nov 09 02:11:18 user nova-compute[75438]:     <apic/>
Nov 09 02:11:18 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:11:18 user nova-compute[75438]:   </features>
Nov 09 02:11:18 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:11:18 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:11:18 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:11:18 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:11:18 user nova-compute[75438]:   </clock>
Nov 09 02:11:18 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:11:18 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:11:18 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:11:18 user nova-compute[75438]:   </cpu>
Nov 09 02:11:18 user nova-compute[75438]:   <devices>
Nov 09 02:11:18 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:11:18 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:11:18 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk"/>
Nov 09 02:11:18 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:11:18 user nova-compute[75438]:     </disk>
Nov 09 02:11:18 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:11:18 user nova-compute[75438]:       <mac address="fa:16:3e:94:2b:ac"/>
Nov 09 02:11:18 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:11:18 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:11:18 user nova-compute[75438]:       <target dev="tape62b5ee2-b0"/>
Nov 09 02:11:18 user nova-compute[75438]:     </interface>
Nov 09 02:11:18 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:11:18 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/console.log" append="off"/>
Nov 09 02:11:18 user nova-compute[75438]:     </serial>
Nov 09 02:11:18 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:11:18 user nova-compute[75438]:     <video>
Nov 09 02:11:18 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:11:18 user nova-compute[75438]:     </video>
Nov 09 02:11:18 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:11:18 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:11:18 user nova-compute[75438]:     </rng>
Nov 09 02:11:18 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:11:18 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:11:18 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:11:18 user nova-compute[75438]:     </memballoon>
Nov 09 02:11:18 user nova-compute[75438]:   </devices>
Nov 09 02:11:18 user nova-compute[75438]: </domain>
Nov 09 02:11:18 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2017582046',display_name='tempest-ServerRescueNegativeTestJSON-server-2017582046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2017582046',id=18,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1p/3B+c15jCLdpAkQLerArcyvJcCFaICTi+O31TuA5oQKNx0JzlTlHURY+pMWgl/LUvKYUWiZueWxJGQ7iMmyKEKvZxPV5oIJyvUy79GVwlsEBGGVkupiWcyov7Dv4ng==',key_name='tempest-keypair-544213512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-jtr2iw2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG os_vif [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '955eebcc-585d-587d-9e06-5074da196cdc', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape62b5ee2-b0, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape62b5ee2-b0, col_values=(('qos', UUID('9be4e7af-ff24-4502-aeb4-a6374361d97a')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape62b5ee2-b0, col_values=(('external_ids', {'iface-id': 'e62b5ee2-b006-48b2-a038-94869d96fc8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:2b:ac', 'vm-uuid': '7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:18 user nova-compute[75438]: INFO os_vif [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0')
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:94:2b:ac, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.neutron [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updated VIF entry in instance network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG nova.network.neutron [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:11:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9d3cfd2f-0a29-4f55-91f8-f4e6709c6a4f req-915bcc95-2288-47f7-95f2-10a9032fab55 service nova] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing instance network info cache due to event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG nova.network.neutron [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:20 user nova-compute[75438]: INFO nova.compute.manager [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] instance snapshotting
Nov 09 02:11:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Beginning live snapshot process
Nov 09 02:11:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updated VIF entry in instance network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ca5f5211-cd3c-429f-b9de-bf1235101e23 req-bc336c7c-2c28-4918-9cbd-c3fb976952f2 service nova] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.230s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8_b2pcas/820ecb48bf8c40e6b3c7b94c7f306ca0.delta 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8_b2pcas/820ecb48bf8c40e6b3c7b94c7f306ca0.delta 1073741824" returned: 0 in 0.063s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:11:21 user nova-compute[75438]: WARNING nova.compute.manager [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state building and task_state spawning.
Nov 09 02:11:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:11:21 user nova-compute[75438]: WARNING nova.compute.manager [req-79a9afb7-6bf9-4c22-bd60-6911a1a57af6 req-2c78dc5f-66f2-4d44-bdef-53c7b1f0fa9b service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state building and task_state spawning.
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:11:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance spawned successfully.
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:11:22 user nova-compute[75438]: INFO nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:11:22 user nova-compute[75438]: INFO nova.compute.manager [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Took 7.17 seconds to build instance.
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:11:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 02:11:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7e3c5831-e559-4742-9ac6-ccb5bb676201 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.287s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:11:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8_b2pcas/820ecb48bf8c40e6b3c7b94c7f306ca0.delta /opt/stack/data/nova/instances/snapshots/tmp8_b2pcas/820ecb48bf8c40e6b3c7b94c7f306ca0 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8_b2pcas/820ecb48bf8c40e6b3c7b94c7f306ca0.delta /opt/stack/data/nova/instances/snapshots/tmp8_b2pcas/820ecb48bf8c40e6b3c7b94c7f306ca0" returned: 0 in 0.430s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Snapshot extracted, beginning image upload
Nov 09 02:11:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:23 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Snapshot image upload complete
Nov 09 02:11:26 user nova-compute[75438]: INFO nova.compute.manager [None req-f8dfe76c-22e6-4b9e-a3ad-b21c628e5f48 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Took 6.36 seconds to snapshot the instance on the hypervisor.
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:29 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:11:29 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=25.192272186279297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 05bf2ae1-5578-4573-b0c7-9ce14999da93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:11:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:11:30 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:11:30 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:11:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:30 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:11:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [{"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-05bf2ae1-5578-4573-b0c7-9ce14999da93" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:11:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-changed-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Refreshing instance network info cache due to event network-changed-28474d81-f7a1-4202-a5c1-d6a169cf3675. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] Acquiring lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] Acquired lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:11:35 user nova-compute[75438]: DEBUG nova.network.neutron [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Refreshing network info cache for port 28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:11:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updated VIF entry in instance network info cache for port 28474d81-f7a1-4202-a5c1-d6a169cf3675. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:11:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updating instance_info_cache with network_info: [{"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:11:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0deadbf0-e635-46ba-80ca-fcd21192c609 req-aa9c1f71-ab93-44c7-ac24-29db9114ff57 service nova] Releasing lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:11:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG nova.objects.instance [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'flavor' on Instance uuid bb481848-5207-4f0b-b56e-8a48bde425f8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:41 user nova-compute[75438]: INFO nova.compute.manager [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Attaching volume daa02018-a59d-4903-9ac2-453e2581e655 to /dev/vdb
Nov 09 02:11:41 user nova-compute[75438]: DEBUG os_brick.utils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b29629e-2d9a-463d-bea2-300fcb43ab0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:41 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0613f9d0-4549-4841-8eae-302a1b9e146f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93aea9e-8aef-4d82-ac00-2b88b72a6d1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d5748-70a0-47fd-a8ff-9101caf2c876]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:11:42 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:11:42 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[47acf641-994d-41b4-9bc9-34d6f3a5e30d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG os_brick.utils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:11:42 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updating existing volume attachment record: f4549e64-da6a-493e-a226-b551bad5002a {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:11:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:47 user nova-compute[75438]: INFO nova.compute.manager [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Terminating instance
Nov 09 02:11:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-b702cc8f-4fb4-4f5d-ad69-3f795b2b0af0 req-f5031fb6-a0ef-43a8-bbf5-91595abdf120 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b702cc8f-4fb4-4f5d-ad69-3f795b2b0af0 req-f5031fb6-a0ef-43a8-bbf5-91595abdf120 service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b702cc8f-4fb4-4f5d-ad69-3f795b2b0af0 req-f5031fb6-a0ef-43a8-bbf5-91595abdf120 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b702cc8f-4fb4-4f5d-ad69-3f795b2b0af0 req-f5031fb6-a0ef-43a8-bbf5-91595abdf120 service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-b702cc8f-4fb4-4f5d-ad69-3f795b2b0af0 req-f5031fb6-a0ef-43a8-bbf5-91595abdf120 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-b702cc8f-4fb4-4f5d-ad69-3f795b2b0af0 req-f5031fb6-a0ef-43a8-bbf5-91595abdf120 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-unplugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Instance destroyed successfully.
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lazy-loading 'resources' on Instance uuid 05bf2ae1-5578-4573-b0c7-9ce14999da93 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-900109230',display_name='tempest-ServerActionsTestOtherB-server-900109230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-900109230',id=3,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiRhrGj26mgE0ksinc8Aj3gmpKbQwqHFncFOPHqvvbxbBVIZkZb04JAatAt2Bp1cisqwzA6vSuB/+I21lnUZZnzvOT4OYYiM0Cje7sfYugAghS/0n7vj9Jc9PvkProOUg==',key_name='tempest-keypair-601371148',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a20628afe4aa4c0aae9c883d4531cc74',ramdisk_id='',reservation_id='r-0c5ldmn1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1383355237',owner_user_name='tempest-ServerActionsTestOtherB-1383355237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be52867f38a447129d9960106a2525f7',uuid=05bf2ae1-5578-4573-b0c7-9ce14999da93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converting VIF {"id": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "address": "fa:16:3e:87:5b:eb", "network": {"id": "91b39d3a-728a-47c0-8234-b28f30df97c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-971753495-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a20628afe4aa4c0aae9c883d4531cc74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c8b67f2-a6", "ovs_interfaceid": "9c8b67f2-a61a-4580-85c9-ee3583275dc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_vif [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c8b67f2-a6, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aff866be-503d-4615-92f7-dfe008799688) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:48 user nova-compute[75438]: INFO os_vif [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=9c8b67f2-a61a-4580-85c9-ee3583275dc7,network=Network(91b39d3a-728a-47c0-8234-b28f30df97c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c8b67f2-a6')
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvMokQxc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:11:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[77497d1d-9fa3-4d9d-9a46-46aa2660162b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:11:48 user nova-compute[75438]: No targets found.
Nov 09 02:11:48 user nova-compute[75438]: iSNS:
Nov 09 02:11:48 user nova-compute[75438]: No targets found.
Nov 09 02:11:48 user nova-compute[75438]: STATIC:
Nov 09 02:11:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553
Nov 09 02:11:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:11:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:11:48 user nova-compute[75438]: FIRMWARE:
Nov 09 02:11:48 user nova-compute[75438]: No targets found.
Nov 09 02:11:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:11:48 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:11:48 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf614d-c557-4a30-8f24-5336f0043c83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[479b1260-6fb1-4371-b7ef-991f73286027]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:11:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 (non-flash)
Nov 09 02:11:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0463fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[06292a94-b7f9-4756-949b-d0c61d94cab3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6740ab9-370d-4a0b-9c0b-c77237e5f8c8]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b1561-5875-46ae-a4cd-b1cb89bfde17]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5597131-811e-4d5b-be6e-0d710019f087]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ffe2b3-b486-48e6-bc8d-057625026118]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d2514-3f58-4b7e-a621-bffaba9e3b6c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260]
Nov 09 02:11:48 user nova-compute[75438]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553, portal: 172.16.0.220,3260] successful.
Nov 09 02:11:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12d5308d-cae3-4796-b701-cd59e18bf553 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[10add4e8-5ee6-4961-9cf5-df0d83fd6588]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] <== disconnect_volume: return (329ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:11:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Deleting instance files /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93_del
Nov 09 02:11:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Deletion of /opt/stack/data/nova/instances/05bf2ae1-5578-4573-b0c7-9ce14999da93_del complete
Nov 09 02:11:48 user nova-compute[75438]: INFO nova.compute.manager [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 09 02:11:48 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:11:48 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:11:49 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:11:49 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Took 0.80 seconds to deallocate network for instance.
Nov 09 02:11:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-b4c78f36-4eef-4e70-a7f5-c77b4b569123 req-34394b39-2163-41ec-801c-c92b6eb48735 service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-deleted-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-ce87b52c-8b40-4738-98b9-d46ce4bdc4ce req-68e4afe4-b121-4521-9d57-b29919a8f02b service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:11:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ce87b52c-8b40-4738-98b9-d46ce4bdc4ce req-68e4afe4-b121-4521-9d57-b29919a8f02b service nova] Acquiring lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ce87b52c-8b40-4738-98b9-d46ce4bdc4ce req-68e4afe4-b121-4521-9d57-b29919a8f02b service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ce87b52c-8b40-4738-98b9-d46ce4bdc4ce req-68e4afe4-b121-4521-9d57-b29919a8f02b service nova] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-ce87b52c-8b40-4738-98b9-d46ce4bdc4ce req-68e4afe4-b121-4521-9d57-b29919a8f02b service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] No waiting events found dispatching network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:11:50 user nova-compute[75438]: WARNING nova.compute.manager [req-ce87b52c-8b40-4738-98b9-d46ce4bdc4ce req-68e4afe4-b121-4521-9d57-b29919a8f02b service nova] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Received unexpected event network-vif-plugged-9c8b67f2-a61a-4580-85c9-ee3583275dc7 for instance with vm_state active and task_state deleting.
Nov 09 02:11:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:50 user nova-compute[75438]: INFO nova.compute.manager [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] [instance: 05bf2ae1-5578-4573-b0c7-9ce14999da93] Took 0.98 seconds to detach 1 volumes for instance.
Nov 09 02:11:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:11:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:11:51 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:11:51 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:11:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:51 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Deleted allocations for instance 05bf2ae1-5578-4573-b0c7-9ce14999da93
Nov 09 02:11:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a6ad4b19-4983-4741-a911-8bb2f0135dd6 tempest-ServerActionsTestOtherB-1383355237 tempest-ServerActionsTestOtherB-1383355237-project-member] Lock "05bf2ae1-5578-4573-b0c7-9ce14999da93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.738s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:11:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:11:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:19 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:12:19 user nova-compute[75438]: INFO nova.compute.claims [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Claim successful on node user
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.network.neutron [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:12:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.policy [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '173f61ba6555421b8f09a996aee60807', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a44c6747d124716b0bcab5f94ac82f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:12:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Creating image(s)
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "/opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "/opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.240s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Successfully created port: 5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk 1073741824" returned: 0 in 0.059s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'info_cache' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Cannot resize image /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Ensure instance console log exists: /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Successfully updated port: 5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:12:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance destroyed successfully.
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'resources' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "refresh_cache-b0e68f49-e30d-4530-ae6c-2f3029916a70" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquired lock "refresh_cache-b0e68f49-e30d-4530-ae6c-2f3029916a70" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG os_vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71877205-b0, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-changed-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Refreshing instance network info cache due to event network-changed-5bb7a744-7e18-42c0-9f58-22bcb9376aeb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] Acquiring lock "refresh_cache-b0e68f49-e30d-4530-ae6c-2f3029916a70" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b33dbaf5-6e46-40f0-ba0c-a5bdd2ff3a1f) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: INFO os_vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0')
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start _get_guest_xml network_info=[{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'numa_topology' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'vcpu_model' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'pci_devices' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:12:22 user nova-compute[75438]:   <uuid>a300e943-2854-4f88-97b1-8d2e2b754f12</uuid>
Nov 09 02:12:22 user nova-compute[75438]:   <name>instance-00000005</name>
Nov 09 02:12:22 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:12:22 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:12:22 user nova-compute[75438]:   <metadata>
Nov 09 02:12:22 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:12:22 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeTestJSON-server-455427829</nova:name>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:12:22</nova:creationTime>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:12:22 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:12:22 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:owner>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:user uuid="6a26a0160e8042e3a6a83bdb28a41ad0">tempest-AttachVolumeTestJSON-74588244-project-member</nova:user>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:project uuid="be67d22752084a76b41a4e1cff3747cf">tempest-AttachVolumeTestJSON-74588244</nova:project>
Nov 09 02:12:22 user nova-compute[75438]:       </nova:owner>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:ports>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:port uuid="71877205-b0ab-456f-a4e1-9e5f638fb7fc">
Nov 09 02:12:22 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:12:22 user nova-compute[75438]:         </nova:port>
Nov 09 02:12:22 user nova-compute[75438]:       </nova:ports>
Nov 09 02:12:22 user nova-compute[75438]:     </nova:instance>
Nov 09 02:12:22 user nova-compute[75438]:   </metadata>
Nov 09 02:12:22 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:12:22 user nova-compute[75438]:     <system>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="serial">a300e943-2854-4f88-97b1-8d2e2b754f12</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="uuid">a300e943-2854-4f88-97b1-8d2e2b754f12</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:12:22 user nova-compute[75438]:     </system>
Nov 09 02:12:22 user nova-compute[75438]:   </sysinfo>
Nov 09 02:12:22 user nova-compute[75438]:   <os>
Nov 09 02:12:22 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:12:22 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:12:22 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:12:22 user nova-compute[75438]:   </os>
Nov 09 02:12:22 user nova-compute[75438]:   <features>
Nov 09 02:12:22 user nova-compute[75438]:     <acpi/>
Nov 09 02:12:22 user nova-compute[75438]:     <apic/>
Nov 09 02:12:22 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:12:22 user nova-compute[75438]:   </features>
Nov 09 02:12:22 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:12:22 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:12:22 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:12:22 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:12:22 user nova-compute[75438]:   </clock>
Nov 09 02:12:22 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:12:22 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:12:22 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:12:22 user nova-compute[75438]:   </cpu>
Nov 09 02:12:22 user nova-compute[75438]:   <devices>
Nov 09 02:12:22 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:12:22 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:12:22 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk"/>
Nov 09 02:12:22 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:12:22 user nova-compute[75438]:     </disk>
Nov 09 02:12:22 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:12:22 user nova-compute[75438]:       <mac address="fa:16:3e:81:73:9c"/>
Nov 09 02:12:22 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:12:22 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:12:22 user nova-compute[75438]:       <target dev="tap71877205-b0"/>
Nov 09 02:12:22 user nova-compute[75438]:     </interface>
Nov 09 02:12:22 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:12:22 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/console.log" append="off"/>
Nov 09 02:12:22 user nova-compute[75438]:     </serial>
Nov 09 02:12:22 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:12:22 user nova-compute[75438]:     <video>
Nov 09 02:12:22 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:12:22 user nova-compute[75438]:     </video>
Nov 09 02:12:22 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:12:22 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:12:22 user nova-compute[75438]:     </rng>
Nov 09 02:12:22 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:12:22 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:12:22 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:12:22 user nova-compute[75438]:     </memballoon>
Nov 09 02:12:22 user nova-compute[75438]:   </devices>
Nov 09 02:12:22 user nova-compute[75438]: </domain>
Nov 09 02:12:22 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Updating instance_info_cache with network_info: [{"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Releasing lock "refresh_cache-b0e68f49-e30d-4530-ae6c-2f3029916a70" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Instance network_info: |[{"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] Acquired lock "refresh_cache-b0e68f49-e30d-4530-ae6c-2f3029916a70" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Refreshing network info cache for port 5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Start _get_guest_xml network_info=[{"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:12:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-361849526',display_name='tempest-ServersNegativeTestJSON-server-361849526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-361849526',id=19,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a44c6747d124716b0bcab5f94ac82f1',ramdisk_id='',reservation_id='r-0zqbk513',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1310159943',owner_user_name='tempest-ServersNegativeTestJSON-1310159943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:12:21Z,user_data=None,user_id='173f61ba6555421b8f09a996aee60807',uuid=b0e68f49-e30d-4530-ae6c-2f3029916a70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converting VIF {"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lazy-loading 'pci_devices' on Instance uuid b0e68f49-e30d-4530-ae6c-2f3029916a70 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'trusted_certs' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:12:22 user nova-compute[75438]:   <uuid>b0e68f49-e30d-4530-ae6c-2f3029916a70</uuid>
Nov 09 02:12:22 user nova-compute[75438]:   <name>instance-00000013</name>
Nov 09 02:12:22 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:12:22 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:12:22 user nova-compute[75438]:   <metadata>
Nov 09 02:12:22 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:12:22 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:name>tempest-ServersNegativeTestJSON-server-361849526</nova:name>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:12:22</nova:creationTime>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:12:22 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:12:22 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:owner>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:user uuid="173f61ba6555421b8f09a996aee60807">tempest-ServersNegativeTestJSON-1310159943-project-member</nova:user>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:project uuid="8a44c6747d124716b0bcab5f94ac82f1">tempest-ServersNegativeTestJSON-1310159943</nova:project>
Nov 09 02:12:22 user nova-compute[75438]:       </nova:owner>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:12:22 user nova-compute[75438]:       <nova:ports>
Nov 09 02:12:22 user nova-compute[75438]:         <nova:port uuid="5bb7a744-7e18-42c0-9f58-22bcb9376aeb">
Nov 09 02:12:22 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:12:22 user nova-compute[75438]:         </nova:port>
Nov 09 02:12:22 user nova-compute[75438]:       </nova:ports>
Nov 09 02:12:22 user nova-compute[75438]:     </nova:instance>
Nov 09 02:12:22 user nova-compute[75438]:   </metadata>
Nov 09 02:12:22 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:12:22 user nova-compute[75438]:     <system>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="serial">b0e68f49-e30d-4530-ae6c-2f3029916a70</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="uuid">b0e68f49-e30d-4530-ae6c-2f3029916a70</entry>
Nov 09 02:12:22 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:12:22 user nova-compute[75438]:     </system>
Nov 09 02:12:22 user nova-compute[75438]:   </sysinfo>
Nov 09 02:12:22 user nova-compute[75438]:   <os>
Nov 09 02:12:22 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:12:22 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:12:22 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:12:22 user nova-compute[75438]:   </os>
Nov 09 02:12:22 user nova-compute[75438]:   <features>
Nov 09 02:12:22 user nova-compute[75438]:     <acpi/>
Nov 09 02:12:22 user nova-compute[75438]:     <apic/>
Nov 09 02:12:22 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:12:22 user nova-compute[75438]:   </features>
Nov 09 02:12:22 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:12:22 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:12:22 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:12:22 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:12:22 user nova-compute[75438]:   </clock>
Nov 09 02:12:22 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:12:22 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:12:22 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:12:22 user nova-compute[75438]:   </cpu>
Nov 09 02:12:22 user nova-compute[75438]:   <devices>
Nov 09 02:12:22 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:12:22 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:12:22 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk"/>
Nov 09 02:12:22 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:12:22 user nova-compute[75438]:     </disk>
Nov 09 02:12:22 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:12:22 user nova-compute[75438]:       <mac address="fa:16:3e:b6:8c:a2"/>
Nov 09 02:12:22 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:12:22 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:12:22 user nova-compute[75438]:       <target dev="tap5bb7a744-7e"/>
Nov 09 02:12:22 user nova-compute[75438]:     </interface>
Nov 09 02:12:22 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:12:22 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/console.log" append="off"/>
Nov 09 02:12:22 user nova-compute[75438]:     </serial>
Nov 09 02:12:22 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:12:22 user nova-compute[75438]:     <video>
Nov 09 02:12:22 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:12:22 user nova-compute[75438]:     </video>
Nov 09 02:12:22 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:12:22 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:12:22 user nova-compute[75438]:     </rng>
Nov 09 02:12:22 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:12:22 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:12:22 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:12:22 user nova-compute[75438]:     </memballoon>
Nov 09 02:12:22 user nova-compute[75438]:   </devices>
Nov 09 02:12:22 user nova-compute[75438]: </domain>
Nov 09 02:12:22 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-361849526',display_name='tempest-ServersNegativeTestJSON-server-361849526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-361849526',id=19,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a44c6747d124716b0bcab5f94ac82f1',ramdisk_id='',reservation_id='r-0zqbk513',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1310159943',owner_user_name='tempest-ServersNegativeTestJSON-1310159943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:12:21Z,user_data=None,user_id='173f61ba6555421b8f09a996aee60807',uuid=b0e68f49-e30d-4530-ae6c-2f3029916a70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converting VIF {"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG os_vif [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a7b2fc5-d3b2-5d8e-a052-69172b4fc8e2', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bb7a744-7e, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bb7a744-7e, col_values=(('qos', UUID('f976d048-b447-4085-94d2-c74281e97517')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bb7a744-7e, col_values=(('external_ids', {'iface-id': '5bb7a744-7e18-42c0-9f58-22bcb9376aeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:8c:a2', 'vm-uuid': 'b0e68f49-e30d-4530-ae6c-2f3029916a70'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:22 user nova-compute[75438]: INFO os_vif [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e')
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] No VIF found with MAC fa:16:3e:b6:8c:a2, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:12:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Updated VIF entry in instance network info cache for port 5bb7a744-7e18-42c0-9f58-22bcb9376aeb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Updating instance_info_cache with network_info: [{"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac4627ab-d615-4dcf-98ab-b280cbd6db30 req-c9087a00-66c2-4d57-a777-b62be652d577 service nova] Releasing lock "refresh_cache-b0e68f49-e30d-4530-ae6c-2f3029916a70" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Cannot resize image /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'migration_context' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Object Instance<a300e943-2854-4f88-97b1-8d2e2b754f12> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:10:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG os_vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92bb3039-d6c5-56dc-b4a9-e30ab4f6317c', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71877205-b0, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71877205-b0, col_values=(('qos', UUID('85085519-b267-4d44-bce0-ea5384512149')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71877205-b0, col_values=(('external_ids', {'iface-id': '71877205-b0ab-456f-a4e1-9e5f638fb7fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:73:9c', 'vm-uuid': 'a300e943-2854-4f88-97b1-8d2e2b754f12'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:23 user nova-compute[75438]: INFO os_vif [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0')
Nov 09 02:12:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-fbe3818e-b08d-427c-b889-1d82dc3c8e02 req-cef0a6f1-fa70-4ea5-b9d4-22b86a35a5e5 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fbe3818e-b08d-427c-b889-1d82dc3c8e02 req-cef0a6f1-fa70-4ea5-b9d4-22b86a35a5e5 service nova] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fbe3818e-b08d-427c-b889-1d82dc3c8e02 req-cef0a6f1-fa70-4ea5-b9d4-22b86a35a5e5 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fbe3818e-b08d-427c-b889-1d82dc3c8e02 req-cef0a6f1-fa70-4ea5-b9d4-22b86a35a5e5 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-fbe3818e-b08d-427c-b889-1d82dc3c8e02 req-cef0a6f1-fa70-4ea5-b9d4-22b86a35a5e5 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] No waiting events found dispatching network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:12:25 user nova-compute[75438]: WARNING nova.compute.manager [req-fbe3818e-b08d-427c-b889-1d82dc3c8e02 req-cef0a6f1-fa70-4ea5-b9d4-22b86a35a5e5 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received unexpected event network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb for instance with vm_state building and task_state spawning.
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-f64d2d73-05eb-4d25-9db3-bc68f4c3449c req-95a89e2c-2ddf-4842-aa86-eed5e2bb8310 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f64d2d73-05eb-4d25-9db3-bc68f4c3449c req-95a89e2c-2ddf-4842-aa86-eed5e2bb8310 service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f64d2d73-05eb-4d25-9db3-bc68f4c3449c req-95a89e2c-2ddf-4842-aa86-eed5e2bb8310 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f64d2d73-05eb-4d25-9db3-bc68f4c3449c req-95a89e2c-2ddf-4842-aa86-eed5e2bb8310 service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-f64d2d73-05eb-4d25-9db3-bc68f4c3449c req-95a89e2c-2ddf-4842-aa86-eed5e2bb8310 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:12:25 user nova-compute[75438]: WARNING nova.compute.manager [req-f64d2d73-05eb-4d25-9db3-bc68f4c3449c req-95a89e2c-2ddf-4842-aa86-eed5e2bb8310 service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state stopped and task_state powering-on.
Nov 09 02:12:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:26 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-59ceadcd-7bac-4024-a468-31964c805516 req-c44f730f-cd35-4951-80ad-357c891587e1 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59ceadcd-7bac-4024-a468-31964c805516 req-c44f730f-cd35-4951-80ad-357c891587e1 service nova] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59ceadcd-7bac-4024-a468-31964c805516 req-c44f730f-cd35-4951-80ad-357c891587e1 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59ceadcd-7bac-4024-a468-31964c805516 req-c44f730f-cd35-4951-80ad-357c891587e1 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-59ceadcd-7bac-4024-a468-31964c805516 req-c44f730f-cd35-4951-80ad-357c891587e1 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] No waiting events found dispatching network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:12:27 user nova-compute[75438]: WARNING nova.compute.manager [req-59ceadcd-7bac-4024-a468-31964c805516 req-c44f730f-cd35-4951-80ad-357c891587e1 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received unexpected event network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb for instance with vm_state building and task_state spawning.
Nov 09 02:12:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-9856b3d8-8848-4184-a2e6-d7f909c33ed2 req-c16cbe79-e2d2-45dc-8b35-c040e92d663b service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9856b3d8-8848-4184-a2e6-d7f909c33ed2 req-c16cbe79-e2d2-45dc-8b35-c040e92d663b service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9856b3d8-8848-4184-a2e6-d7f909c33ed2 req-c16cbe79-e2d2-45dc-8b35-c040e92d663b service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9856b3d8-8848-4184-a2e6-d7f909c33ed2 req-c16cbe79-e2d2-45dc-8b35-c040e92d663b service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-9856b3d8-8848-4184-a2e6-d7f909c33ed2 req-c16cbe79-e2d2-45dc-8b35-c040e92d663b service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:12:27 user nova-compute[75438]: WARNING nova.compute.manager [req-9856b3d8-8848-4184-a2e6-d7f909c33ed2 req-c16cbe79-e2d2-45dc-8b35-c040e92d663b service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state stopped and task_state powering-on.
Nov 09 02:12:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:12:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Instance spawned successfully.
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:12:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance rebooted successfully.
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e72a7a0d-aa74-4b33-9d48-243ff45f1e4d tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:12:28 user nova-compute[75438]: INFO nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Took 7.88 seconds to spawn the instance on the hypervisor.
Nov 09 02:12:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:28 user nova-compute[75438]: INFO nova.compute.manager [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Took 8.85 seconds to build instance.
Nov 09 02:12:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-316f78c5-c6d7-499f-b481-2e2188791375 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.965s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:34 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:34 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.177276611328125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b0e68f49-e30d-4530-ae6c-2f3029916a70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtCVfows', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:12:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:12:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:12:37 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79e759-a440-45e1-828f-b69d115b7b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:12:37 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d94859-96e6-4f6f-98a4-04a7e94a9392]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655] added
Nov 09 02:12:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[478aadbe-850d-47f0-b826-3a41e4fa8230]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[069736a2-197c-4ea5-aed7-755d1a97d55b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtCVfows {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtCVfows" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6251e7-c00b-4e1a-982f-edb1499aa3df]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtCVfows'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d101d8-711b-446a-ba89-d80a2469a8ee]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2297347c-1564-4c9d-b322-f9317c6d48b6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:12:37 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:12:37 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:12:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:12:37 user nova-compute[75438]: 
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e8dfe0-3f22-442b-83f7-58f58267770d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260]
Nov 09 02:12:38 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260] successful.
Nov 09 02:12:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9ba373-02c9-41b6-9ea8-b89ada5a1708]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ccd707-3e07-40f0-b70b-756c2ca0f780]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 (non-flash)
Nov 09 02:12:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 (non-flash)
Nov 09 02:12:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a5c0e2-c553-4f7c-aca3-506726344fa3]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:12:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtCVfows', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23839313937353634', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839313937353634', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'flavor' on Instance uuid bb481848-5207-4f0b-b56e-8a48bde425f8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:12:39 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:12:39 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:12:39 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:12:39 user nova-compute[75438]:   <serial>daa02018-a59d-4903-9ac2-453e2581e655</serial>
Nov 09 02:12:39 user nova-compute[75438]: </disk>
Nov 09 02:12:39 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No VIF found with MAC fa:16:3e:cd:9d:59, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:12:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-91a4e011-93d2-4d57-8ab5-c23673adf3cd tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.902s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:12:40 user nova-compute[75438]: INFO nova.compute.claims [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Claim successful on node user
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:12:40 user nova-compute[75438]: INFO nova.compute.manager [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Detaching volume daa02018-a59d-4903-9ac2-453e2581e655
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:12:40 user nova-compute[75438]: INFO nova.virt.block_device [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Attempting to driver detach volume daa02018-a59d-4903-9ac2-453e2581e655 from mountpoint /dev/vdb
Nov 09 02:12:40 user nova-compute[75438]: DEBUG nova.policy [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95d2465b0af4dcab397b5ccc2809c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4b29710bb14b8fb9714109aec43dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Attempting to detach device vdb from instance bb481848-5207-4f0b-b56e-8a48bde425f8 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:12:41 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:12:41 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:12:41 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:12:41 user nova-compute[75438]:   <serial>daa02018-a59d-4903-9ac2-453e2581e655</serial>
Nov 09 02:12:41 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:12:41 user nova-compute[75438]: </disk>
Nov 09 02:12:41 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:12:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Successfully detached device vdb from instance bb481848-5207-4f0b-b56e-8a48bde425f8 from the persistent domain config.
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb481848-5207-4f0b-b56e-8a48bde425f8 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:12:41 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:12:41 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:12:41 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:12:41 user nova-compute[75438]:   <serial>daa02018-a59d-4903-9ac2-453e2581e655</serial>
Nov 09 02:12:41 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:12:41 user nova-compute[75438]: </disk>
Nov 09 02:12:41 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:12:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Creating image(s)
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk 1073741824" returned: 0 in 0.060s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb481848-5207-4f0b-b56e-8a48bde425f8 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.235s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:41 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Successfully created port: 40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Cannot resize image /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Ensure instance console log exists: /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Successfully updated port: 40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquired lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:12:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-changed-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Refreshing instance network info cache due to event network-changed-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] Acquiring lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updating instance_info_cache with network_info: [{"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Releasing lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance network_info: |[{"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] Acquired lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.neutron [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Refreshing network info cache for port 40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Start _get_guest_xml network_info=[{"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:12:43 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:43 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1069873586',display_name='tempest-tempest.common.compute-instance-1069873586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1069873586',id=20,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY0jLkcGufpfBdu/y9o49RBsRGgTXVSjBjf2C7iYfthjQWpmZCBzLxp9Vt68/r4MB2JcjuWyuMtgyxlmcrRIR84pgpDcpS6QpDg62POpG8vOnhxC2w0TRYFSJLpyoKA6w==',key_name='tempest-keypair-355792053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-xxvqv43c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=a3b47518-63f5-4a38-834d-5627bec3892d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'pci_devices' on Instance uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:12:43 user nova-compute[75438]:   <uuid>a3b47518-63f5-4a38-834d-5627bec3892d</uuid>
Nov 09 02:12:43 user nova-compute[75438]:   <name>instance-00000014</name>
Nov 09 02:12:43 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:12:43 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:12:43 user nova-compute[75438]:   <metadata>
Nov 09 02:12:43 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:12:43 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:12:43 user nova-compute[75438]:       <nova:name>tempest-tempest.common.compute-instance-1069873586</nova:name>
Nov 09 02:12:43 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:12:43</nova:creationTime>
Nov 09 02:12:43 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:12:43 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:12:43 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:12:43 user nova-compute[75438]:       <nova:owner>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:user uuid="e95d2465b0af4dcab397b5ccc2809c59">tempest-ServerActionsTestOtherA-1813489270-project-member</nova:user>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:project uuid="7a4b29710bb14b8fb9714109aec43dc6">tempest-ServerActionsTestOtherA-1813489270</nova:project>
Nov 09 02:12:43 user nova-compute[75438]:       </nova:owner>
Nov 09 02:12:43 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:12:43 user nova-compute[75438]:       <nova:ports>
Nov 09 02:12:43 user nova-compute[75438]:         <nova:port uuid="40acfb20-c0f4-47b9-a8c5-87cec6f4f24f">
Nov 09 02:12:43 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:12:43 user nova-compute[75438]:         </nova:port>
Nov 09 02:12:43 user nova-compute[75438]:       </nova:ports>
Nov 09 02:12:43 user nova-compute[75438]:     </nova:instance>
Nov 09 02:12:43 user nova-compute[75438]:   </metadata>
Nov 09 02:12:43 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:12:43 user nova-compute[75438]:     <system>
Nov 09 02:12:43 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:12:43 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:12:43 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:12:43 user nova-compute[75438]:       <entry name="serial">a3b47518-63f5-4a38-834d-5627bec3892d</entry>
Nov 09 02:12:43 user nova-compute[75438]:       <entry name="uuid">a3b47518-63f5-4a38-834d-5627bec3892d</entry>
Nov 09 02:12:43 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:12:43 user nova-compute[75438]:     </system>
Nov 09 02:12:43 user nova-compute[75438]:   </sysinfo>
Nov 09 02:12:43 user nova-compute[75438]:   <os>
Nov 09 02:12:43 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:12:43 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:12:43 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:12:43 user nova-compute[75438]:   </os>
Nov 09 02:12:43 user nova-compute[75438]:   <features>
Nov 09 02:12:43 user nova-compute[75438]:     <acpi/>
Nov 09 02:12:43 user nova-compute[75438]:     <apic/>
Nov 09 02:12:43 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:12:43 user nova-compute[75438]:   </features>
Nov 09 02:12:43 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:12:43 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:12:43 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:12:43 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:12:43 user nova-compute[75438]:   </clock>
Nov 09 02:12:43 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:12:43 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:12:43 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:12:43 user nova-compute[75438]:   </cpu>
Nov 09 02:12:43 user nova-compute[75438]:   <devices>
Nov 09 02:12:43 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:12:43 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:12:43 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk"/>
Nov 09 02:12:43 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:12:43 user nova-compute[75438]:     </disk>
Nov 09 02:12:43 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:12:43 user nova-compute[75438]:       <mac address="fa:16:3e:b0:5e:44"/>
Nov 09 02:12:43 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:12:43 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:12:43 user nova-compute[75438]:       <target dev="tap40acfb20-c0"/>
Nov 09 02:12:43 user nova-compute[75438]:     </interface>
Nov 09 02:12:43 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:12:43 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/console.log" append="off"/>
Nov 09 02:12:43 user nova-compute[75438]:     </serial>
Nov 09 02:12:43 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:12:43 user nova-compute[75438]:     <video>
Nov 09 02:12:43 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:12:43 user nova-compute[75438]:     </video>
Nov 09 02:12:43 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:12:43 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:12:43 user nova-compute[75438]:     </rng>
Nov 09 02:12:43 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:12:43 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:12:43 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:12:43 user nova-compute[75438]:     </memballoon>
Nov 09 02:12:43 user nova-compute[75438]:   </devices>
Nov 09 02:12:43 user nova-compute[75438]: </domain>
Nov 09 02:12:43 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1069873586',display_name='tempest-tempest.common.compute-instance-1069873586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1069873586',id=20,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY0jLkcGufpfBdu/y9o49RBsRGgTXVSjBjf2C7iYfthjQWpmZCBzLxp9Vt68/r4MB2JcjuWyuMtgyxlmcrRIR84pgpDcpS6QpDg62POpG8vOnhxC2w0TRYFSJLpyoKA6w==',key_name='tempest-keypair-355792053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-xxvqv43c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:12:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=a3b47518-63f5-4a38-834d-5627bec3892d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG os_vif [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '817d1e6d-9b64-59e9-8be0-5d14a894f111', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40acfb20-c0, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40acfb20-c0, col_values=(('qos', UUID('24b399ba-525a-41ac-81bd-cb1ac16dcc32')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40acfb20-c0, col_values=(('external_ids', {'iface-id': '40acfb20-c0f4-47b9-a8c5-87cec6f4f24f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5e:44', 'vm-uuid': 'a3b47518-63f5-4a38-834d-5627bec3892d'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:43 user nova-compute[75438]: INFO os_vif [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0')
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No VIF found with MAC fa:16:3e:b0:5e:44, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.neutron [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updated VIF entry in instance network info cache for port 40acfb20-c0f4-47b9-a8c5-87cec6f4f24f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG nova.network.neutron [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updating instance_info_cache with network_info: [{"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:12:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9f56fc80-b666-4f3c-8716-c83b2df45830 req-02bfe919-3375-4203-8874-efe90d549f05 service nova] Releasing lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:12:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-3f8065aa-1d71-4fc1-a4f2-1a146eeba9fd req-e8247982-5564-41bc-9628-425df783a308 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3f8065aa-1d71-4fc1-a4f2-1a146eeba9fd req-e8247982-5564-41bc-9628-425df783a308 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3f8065aa-1d71-4fc1-a4f2-1a146eeba9fd req-e8247982-5564-41bc-9628-425df783a308 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3f8065aa-1d71-4fc1-a4f2-1a146eeba9fd req-e8247982-5564-41bc-9628-425df783a308 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-3f8065aa-1d71-4fc1-a4f2-1a146eeba9fd req-e8247982-5564-41bc-9628-425df783a308 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:12:45 user nova-compute[75438]: WARNING nova.compute.manager [req-3f8065aa-1d71-4fc1-a4f2-1a146eeba9fd req-e8247982-5564-41bc-9628-425df783a308 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state building and task_state spawning.
Nov 09 02:12:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:12:45 user nova-compute[75438]: INFO nova.compute.manager [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] instance snapshotting
Nov 09 02:12:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Beginning live snapshot process
Nov 09 02:12:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpot07iu4l/54f5b7c2305345e39c687d88e52bd07a.delta 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpot07iu4l/54f5b7c2305345e39c687d88e52bd07a.delta 1073741824" returned: 0 in 0.063s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:46 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 02:12:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-bc56a440-2139-49a3-aff6-c9304f6a2102 req-73cc92da-1aa9-46b0-be99-dddd30f75fff service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc56a440-2139-49a3-aff6-c9304f6a2102 req-73cc92da-1aa9-46b0-be99-dddd30f75fff service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc56a440-2139-49a3-aff6-c9304f6a2102 req-73cc92da-1aa9-46b0-be99-dddd30f75fff service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc56a440-2139-49a3-aff6-c9304f6a2102 req-73cc92da-1aa9-46b0-be99-dddd30f75fff service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-bc56a440-2139-49a3-aff6-c9304f6a2102 req-73cc92da-1aa9-46b0-be99-dddd30f75fff service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:12:47 user nova-compute[75438]: WARNING nova.compute.manager [req-bc56a440-2139-49a3-aff6-c9304f6a2102 req-73cc92da-1aa9-46b0-be99-dddd30f75fff service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state building and task_state spawning.
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:12:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance spawned successfully.
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:12:47 user nova-compute[75438]: INFO nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:12:47 user nova-compute[75438]: INFO nova.compute.manager [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Took 7.54 seconds to build instance.
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:12:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 02:12:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5504272e-d0b5-4b48-b864-a68732163cb9 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.645s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:12:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpot07iu4l/54f5b7c2305345e39c687d88e52bd07a.delta /opt/stack/data/nova/instances/snapshots/tmpot07iu4l/54f5b7c2305345e39c687d88e52bd07a {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:12:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpot07iu4l/54f5b7c2305345e39c687d88e52bd07a.delta /opt/stack/data/nova/instances/snapshots/tmpot07iu4l/54f5b7c2305345e39c687d88e52bd07a" returned: 0 in 0.399s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:12:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Snapshot extracted, beginning image upload
Nov 09 02:12:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Snapshot image upload complete
Nov 09 02:12:51 user nova-compute[75438]: INFO nova.compute.manager [None req-f7be45e2-64b7-4dfa-b31f-b351ab83dfef tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Took 6.05 seconds to snapshot the instance on the hypervisor.
Nov 09 02:12:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:12:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:01 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb481848-5207-4f0b-b56e-8a48bde425f8 is timed out.
Nov 09 02:13:01 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Successfully detached device vdb from instance bb481848-5207-4f0b-b56e-8a48bde425f8 from the live domain config.
Nov 09 02:13:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtCVfows', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:01 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c4ad86-9b56-4395-9132-5df20a2f0436]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:13:01 user nova-compute[75438]: No targets found.
Nov 09 02:13:01 user nova-compute[75438]: iSNS:
Nov 09 02:13:01 user nova-compute[75438]: No targets found.
Nov 09 02:13:01 user nova-compute[75438]: STATIC:
Nov 09 02:13:01 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655
Nov 09 02:13:01 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:13:01 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:13:01 user nova-compute[75438]: FIRMWARE:
Nov 09 02:13:01 user nova-compute[75438]: No targets found.
Nov 09 02:13:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:13:01 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:13:01 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d07d77-7491-4a3d-b587-357680b00c9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[376625b9-67af-4db7-8486-c1fbac1d87e2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 (non-flash)
Nov 09 02:13:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 (non-flash)
Nov 09 02:13:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0455fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b78ef-9c6c-4cfe-bc87-37371ccb8991]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce0d960-873b-4291-81ac-fc53a126568b]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d0c09f-d8a1-4a68-8d17-bab373fc0cb1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8976ed88-7e7d-42e2-94a3-583a5401e2e8]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:13:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd4dfd9-07cd-44c0-88fb-2287fcca2390]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa65f8-1b5c-4c74-a073-31779c0af582]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260]
Nov 09 02:13:02 user nova-compute[75438]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655, portal: 172.16.0.220,3260] successful.
Nov 09 02:13:02 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa02018-a59d-4903-9ac2-453e2581e655 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb709d1-35fa-43cb-b620-cb3ca730df30]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] <== disconnect_volume: return (457ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:13:03 user nova-compute[75438]: DEBUG nova.objects.instance [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'flavor' on Instance uuid bb481848-5207-4f0b-b56e-8a48bde425f8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-34912040-a2a6-49a5-aa41-2952ccff8ea9 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.482s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing instance network info cache due to event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG nova.network.neutron [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'flavor' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:07 user nova-compute[75438]: INFO nova.compute.manager [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Attaching volume f999fdad-7ef1-43cf-9b3a-b6f710ab6efd to /dev/vdb
Nov 09 02:13:07 user nova-compute[75438]: DEBUG os_brick.utils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3117900-c27b-4d9c-9217-e7b1e516cfa5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7407dcd-c99f-479b-9f6a-846d3b2ad4d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7d3573-f4b3-4aaf-8bc7-aaccfbbc5df0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[81932d37-5e73-45a2-b65b-bb7ce01377f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:07 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:13:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[580f80e2-0b84-42f0-b9bc-231a3584991d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG os_brick.utils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:07 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating existing volume attachment record: 787864d1-53a8-4036-8298-dbaca5777a07 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:13:08 user nova-compute[75438]: DEBUG nova.network.neutron [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updated VIF entry in instance network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:13:08 user nova-compute[75438]: DEBUG nova.network.neutron [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6442cc64-ed02-4dbb-b727-4b7788464df7 req-cf24f538-9089-4445-b8b8-7d25e1da9dea service nova] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'flavor' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:12 user nova-compute[75438]: INFO nova.compute.manager [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Attaching volume 5a9cc239-1892-42d3-9b7b-846500825f63 to /dev/vdb
Nov 09 02:13:12 user nova-compute[75438]: DEBUG os_brick.utils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee5869-eb3c-4b4d-8f7c-b41c4273201e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[90720bad-8031-445c-b166-3f5c670e7220]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17235e8-d0da-41be-80d0-d591c613f08d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9d524a-aa56-4e58-9115-ed4ad6e7908d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:12 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:13:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475f3c3-a590-4531-899d-6747e1099ceb]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG os_brick.utils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:12 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating existing volume attachment record: 620c846c-6c68-4f6d-84d3-4fcefceec7cc {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:13:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:20 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:13:23 user nova-compute[75438]: INFO nova.compute.claims [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Claim successful on node user
Nov 09 02:13:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.network.neutron [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:13:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:13:23 user nova-compute[75438]: DEBUG nova.policy [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2959b8b821e9406480159ced072408e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c37c1382f74f9689baf00837b8bfa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:13:23 user nova-compute[75438]: INFO nova.virt.block_device [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Booting with volume 09015b7e-a26a-4bb8-afc1-972768386128 at /dev/vda
Nov 09 02:13:24 user nova-compute[75438]: DEBUG os_brick.utils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e8ac5-986a-4c82-bd8f-d109eefd4db3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[058c8bb1-bc4b-4dff-9023-5ba74c6b6150]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b565cd-e098-4525-9ba5-f3e330906b5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8562ffd-f37e-48f3-9912-c3f9133d3a93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:24 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:13:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69526f24-7e8d-4ab3-9645-2f01595542f1]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG os_brick.utils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating existing volume attachment record: 03c08abe-023a-40c3-9e27-2694caa31e86 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:13:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Successfully created port: 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Successfully updated port: 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance network_info: |[{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing instance network info cache due to event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updated VIF entry in instance network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fec56cca-366f-4177-9221-5f7eef27911c req-659c28fc-3420-4c72-9bb2-cd6c0ee1b70c service nova] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [{"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-a300e943-2854-4f88-97b1-8d2e2b754f12" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:32 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=25.056968688964844GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a300e943-2854-4f88-97b1-8d2e2b754f12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance b0e68f49-e30d-4530-ae6c-2f3029916a70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a3b47518-63f5-4a38-834d-5627bec3892d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 896758d5-8945-4fb7-a90f-a86084c7fd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:13:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:13:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:13:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:13:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:13:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:13:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Creating image(s)
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Ensure instance console log exists: /opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Start _get_guest_xml network_info=[{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '03c08abe-023a-40c3-9e27-2694caa31e86', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '896758d5-8945-4fb7-a90f-a86084c7fd3a', 'attached_at': '', 'detached_at': '', 'volume_id': '09015b7e-a26a-4bb8-afc1-972768386128', 'serial': '09015b7e-a26a-4bb8-afc1-972768386128'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:13:47 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:47 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:47 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:13:47 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:13:47 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2845d-b04b-4dba-95c5-139fd2a9908f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:13:47 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c667e36-9a56-4b14-8a8b-6836e34e4c85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128] added
Nov 09 02:13:47 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ee1dce-d93b-4233-ab39-5ae36026161d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6204e239-6315-49dd-9817-76e8d14d013d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnaMHekt {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnaMHekt" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47670e-b391-4c8c-bcb2-bbd1bcacefca]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnaMHekt'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b5fab-ff2c-42f9-a12a-e1208666ba5a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb83d2-b975-4f98-b2e0-7694cb90eaf6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:13:48 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:13:48 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:13:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:13:48 user nova-compute[75438]: 
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3edeb73-8ce7-486f-ba40-37817a4f92dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]
Nov 09 02:13:48 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.
Nov 09 02:13:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[33de3d8c-8755-4ea0-86c8-f8f260291bc7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1f505-b32f-4ca2-83b5-053143b14e6a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:13:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:13:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cb9f26-3117-49e9-b843-af9d4b6acf12]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "256ada78-3695-4784-953b-c57f555a1ee6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:48 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:13:48 user nova-compute[75438]: INFO nova.compute.claims [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Claim successful on node user
Nov 09 02:13:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26134346234636630', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134346234636630', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-808013591',display_name='tempest-TestShelveInstance-server-808013591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-808013591',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlSBy/yEAN4Bi6etvD69gybdSwpkK9G4pYaYUcbe28q3nopNHbXNhwzJ7FXx7caugmEOAgerY48VBohwKxF85Y10hH+MaDCPyz1ofFYxWEZsPEDz/fGE40rgHQ6MMX8Cw==',key_name='tempest-TestShelveInstance-1475462915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c37c1382f74f9689baf00837b8bfa8',ramdisk_id='',reservation_id='r-iysa0vvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-838005507',owner_user_name='tempest-TestShelveInstance-838005507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:24Z,user_data=None,user_id='2959b8b821e9406480159ced072408e6',uuid=896758d5-8945-4fb7-a90f-a86084c7fd3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converting VIF {"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'pci_devices' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:13:49 user nova-compute[75438]:   <uuid>896758d5-8945-4fb7-a90f-a86084c7fd3a</uuid>
Nov 09 02:13:49 user nova-compute[75438]:   <name>instance-00000015</name>
Nov 09 02:13:49 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:13:49 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:13:49 user nova-compute[75438]:   <metadata>
Nov 09 02:13:49 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:13:49 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:13:49 user nova-compute[75438]:       <nova:name>tempest-TestShelveInstance-server-808013591</nova:name>
Nov 09 02:13:49 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:13:47</nova:creationTime>
Nov 09 02:13:49 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:13:49 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:13:49 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:13:49 user nova-compute[75438]:       <nova:owner>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:user uuid="2959b8b821e9406480159ced072408e6">tempest-TestShelveInstance-838005507-project-member</nova:user>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:project uuid="56c37c1382f74f9689baf00837b8bfa8">tempest-TestShelveInstance-838005507</nova:project>
Nov 09 02:13:49 user nova-compute[75438]:       </nova:owner>
Nov 09 02:13:49 user nova-compute[75438]:       <nova:ports>
Nov 09 02:13:49 user nova-compute[75438]:         <nova:port uuid="0dcd4f57-485c-406e-9e6c-7f9dfb5865d8">
Nov 09 02:13:49 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:13:49 user nova-compute[75438]:         </nova:port>
Nov 09 02:13:49 user nova-compute[75438]:       </nova:ports>
Nov 09 02:13:49 user nova-compute[75438]:     </nova:instance>
Nov 09 02:13:49 user nova-compute[75438]:   </metadata>
Nov 09 02:13:49 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:13:49 user nova-compute[75438]:     <system>
Nov 09 02:13:49 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:13:49 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:13:49 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:13:49 user nova-compute[75438]:       <entry name="serial">896758d5-8945-4fb7-a90f-a86084c7fd3a</entry>
Nov 09 02:13:49 user nova-compute[75438]:       <entry name="uuid">896758d5-8945-4fb7-a90f-a86084c7fd3a</entry>
Nov 09 02:13:49 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:13:49 user nova-compute[75438]:     </system>
Nov 09 02:13:49 user nova-compute[75438]:   </sysinfo>
Nov 09 02:13:49 user nova-compute[75438]:   <os>
Nov 09 02:13:49 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:13:49 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:13:49 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:13:49 user nova-compute[75438]:   </os>
Nov 09 02:13:49 user nova-compute[75438]:   <features>
Nov 09 02:13:49 user nova-compute[75438]:     <acpi/>
Nov 09 02:13:49 user nova-compute[75438]:     <apic/>
Nov 09 02:13:49 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:13:49 user nova-compute[75438]:   </features>
Nov 09 02:13:49 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:13:49 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:13:49 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:13:49 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:13:49 user nova-compute[75438]:   </clock>
Nov 09 02:13:49 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:13:49 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:13:49 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:13:49 user nova-compute[75438]:   </cpu>
Nov 09 02:13:49 user nova-compute[75438]:   <devices>
Nov 09 02:13:49 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:13:49 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:13:49 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:13:49 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:13:49 user nova-compute[75438]:       <serial>09015b7e-a26a-4bb8-afc1-972768386128</serial>
Nov 09 02:13:49 user nova-compute[75438]:     </disk>
Nov 09 02:13:49 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:13:49 user nova-compute[75438]:       <mac address="fa:16:3e:21:14:79"/>
Nov 09 02:13:49 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:13:49 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:13:49 user nova-compute[75438]:       <target dev="tap0dcd4f57-48"/>
Nov 09 02:13:49 user nova-compute[75438]:     </interface>
Nov 09 02:13:49 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:13:49 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a/console.log" append="off"/>
Nov 09 02:13:49 user nova-compute[75438]:     </serial>
Nov 09 02:13:49 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:13:49 user nova-compute[75438]:     <video>
Nov 09 02:13:49 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:13:49 user nova-compute[75438]:     </video>
Nov 09 02:13:49 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:13:49 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:13:49 user nova-compute[75438]:     </rng>
Nov 09 02:13:49 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:13:49 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:13:49 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:13:49 user nova-compute[75438]:     </memballoon>
Nov 09 02:13:49 user nova-compute[75438]:   </devices>
Nov 09 02:13:49 user nova-compute[75438]: </domain>
Nov 09 02:13:49 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-808013591',display_name='tempest-TestShelveInstance-server-808013591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-808013591',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlSBy/yEAN4Bi6etvD69gybdSwpkK9G4pYaYUcbe28q3nopNHbXNhwzJ7FXx7caugmEOAgerY48VBohwKxF85Y10hH+MaDCPyz1ofFYxWEZsPEDz/fGE40rgHQ6MMX8Cw==',key_name='tempest-TestShelveInstance-1475462915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c37c1382f74f9689baf00837b8bfa8',ramdisk_id='',reservation_id='r-iysa0vvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-838005507',owner_user_name='tempest-TestShelveInstance-838005507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:24Z,user_data=None,user_id='2959b8b821e9406480159ced072408e6',uuid=896758d5-8945-4fb7-a90f-a86084c7fd3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converting VIF {"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG os_vif [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87be94cc-1fc9-5529-a9a7-264a6cbb96cb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dcd4f57-48, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dcd4f57-48, col_values=(('qos', UUID('d778f597-d617-40da-814d-272558a4697b')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dcd4f57-48, col_values=(('external_ids', {'iface-id': '0dcd4f57-485c-406e-9e6c-7f9dfb5865d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:14:79', 'vm-uuid': '896758d5-8945-4fb7-a90f-a86084c7fd3a'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:49 user nova-compute[75438]: INFO os_vif [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48')
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] No VIF found with MAC fa:16:3e:21:14:79, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:13:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.policy [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '866048ee57714ee7aae7be2a57102b0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '826e2b5db9464d15aa10f4f889e9d320', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:13:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Creating image(s)
Nov 09 02:13:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "/opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "/opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "/opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk 1073741824" returned: 0 in 0.058s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Successfully created port: 71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Checking if we can resize image /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Cannot resize image /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Ensure instance console log exists: /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-83c1b72f-f8f9-4754-a06e-420ddba910ed req-19ed68bb-0ec4-41a9-bf91-ccbd57111b06 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-83c1b72f-f8f9-4754-a06e-420ddba910ed req-19ed68bb-0ec4-41a9-bf91-ccbd57111b06 service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-83c1b72f-f8f9-4754-a06e-420ddba910ed req-19ed68bb-0ec4-41a9-bf91-ccbd57111b06 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-83c1b72f-f8f9-4754-a06e-420ddba910ed req-19ed68bb-0ec4-41a9-bf91-ccbd57111b06 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-83c1b72f-f8f9-4754-a06e-420ddba910ed req-19ed68bb-0ec4-41a9-bf91-ccbd57111b06 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:13:51 user nova-compute[75438]: WARNING nova.compute.manager [req-83c1b72f-f8f9-4754-a06e-420ddba910ed req-19ed68bb-0ec4-41a9-bf91-ccbd57111b06 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state building and task_state spawning.
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Successfully updated port: 71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "refresh_cache-256ada78-3695-4784-953b-c57f555a1ee6" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquired lock "refresh_cache-256ada78-3695-4784-953b-c57f555a1ee6" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-changed-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Refreshing instance network info cache due to event network-changed-71008ce9-f7e4-454d-bf36-308a4bf08b2a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] Acquiring lock "refresh_cache-256ada78-3695-4784-953b-c57f555a1ee6" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSwgIXhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:13:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:13:51 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce124c7-1add-4067-9f0b-a5d0a03ed731]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:13:51 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87216d7-822f-46b7-b1aa-749f902cba58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd] added
Nov 09 02:13:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fa91cd-02c4-4caf-bde6-1624f93a56ee]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Updating instance_info_cache with network_info: [{"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.153s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a815d00d-f498-478d-92d4-72c5025f97b7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Releasing lock "refresh_cache-256ada78-3695-4784-953b-c57f555a1ee6" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Instance network_info: |[{"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSwgIXhi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] Acquired lock "refresh_cache-256ada78-3695-4784-953b-c57f555a1ee6" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.neutron [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Refreshing network info cache for port 71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Start _get_guest_xml network_info=[{"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:13:51 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:51 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSwgIXhi" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade7bdfb-fb69-484c-a446-b06cf8b281af]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HSwgIXhi'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e937634a-c22b-4cc6-8d52-73382de2a8de]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1762093738',display_name='tempest-VolumesAdminNegativeTest-server-1762093738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1762093738',id=22,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e2b5db9464d15aa10f4f889e9d320',ramdisk_id='',reservation_id='r-6n4ivk6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1041878911',owner_user_name='tempest-VolumesAdminNegativeTest-1041878911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:50Z,user_data=None,user_id='866048ee57714ee7aae7be2a57102b0a',uuid=256ada78-3695-4784-953b-c57f555a1ee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converting VIF {"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.objects.instance [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'pci_devices' on Instance uuid 256ada78-3695-4784-953b-c57f555a1ee6 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[482326cc-2e72-4736-ae7e-801f8df26d6a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:13:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:13:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:13:51 user nova-compute[75438]:   <uuid>256ada78-3695-4784-953b-c57f555a1ee6</uuid>
Nov 09 02:13:51 user nova-compute[75438]:   <name>instance-00000016</name>
Nov 09 02:13:51 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:13:51 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:13:51 user nova-compute[75438]:   <metadata>
Nov 09 02:13:51 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:13:51 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:13:51 user nova-compute[75438]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1762093738</nova:name>
Nov 09 02:13:51 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:13:51</nova:creationTime>
Nov 09 02:13:51 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:13:51 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:13:51 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:13:51 user nova-compute[75438]:       <nova:owner>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:user uuid="866048ee57714ee7aae7be2a57102b0a">tempest-VolumesAdminNegativeTest-1041878911-project-member</nova:user>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:project uuid="826e2b5db9464d15aa10f4f889e9d320">tempest-VolumesAdminNegativeTest-1041878911</nova:project>
Nov 09 02:13:51 user nova-compute[75438]:       </nova:owner>
Nov 09 02:13:51 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:13:51 user nova-compute[75438]:       <nova:ports>
Nov 09 02:13:51 user nova-compute[75438]:         <nova:port uuid="71008ce9-f7e4-454d-bf36-308a4bf08b2a">
Nov 09 02:13:51 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:13:51 user nova-compute[75438]:         </nova:port>
Nov 09 02:13:51 user nova-compute[75438]:       </nova:ports>
Nov 09 02:13:51 user nova-compute[75438]:     </nova:instance>
Nov 09 02:13:51 user nova-compute[75438]:   </metadata>
Nov 09 02:13:51 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:13:51 user nova-compute[75438]:     <system>
Nov 09 02:13:51 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:13:51 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:13:51 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:13:51 user nova-compute[75438]:       <entry name="serial">256ada78-3695-4784-953b-c57f555a1ee6</entry>
Nov 09 02:13:51 user nova-compute[75438]:       <entry name="uuid">256ada78-3695-4784-953b-c57f555a1ee6</entry>
Nov 09 02:13:51 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:13:51 user nova-compute[75438]:     </system>
Nov 09 02:13:51 user nova-compute[75438]:   </sysinfo>
Nov 09 02:13:51 user nova-compute[75438]:   <os>
Nov 09 02:13:51 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:13:51 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:13:51 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:13:51 user nova-compute[75438]:   </os>
Nov 09 02:13:51 user nova-compute[75438]:   <features>
Nov 09 02:13:51 user nova-compute[75438]:     <acpi/>
Nov 09 02:13:51 user nova-compute[75438]:     <apic/>
Nov 09 02:13:51 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:13:51 user nova-compute[75438]:   </features>
Nov 09 02:13:51 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:13:51 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:13:51 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:13:51 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:13:51 user nova-compute[75438]:   </clock>
Nov 09 02:13:51 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:13:51 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:13:51 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:13:51 user nova-compute[75438]:   </cpu>
Nov 09 02:13:51 user nova-compute[75438]:   <devices>
Nov 09 02:13:51 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:13:51 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:13:51 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk"/>
Nov 09 02:13:51 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:13:51 user nova-compute[75438]:     </disk>
Nov 09 02:13:51 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:13:51 user nova-compute[75438]:       <mac address="fa:16:3e:33:c8:0f"/>
Nov 09 02:13:51 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:13:51 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:13:51 user nova-compute[75438]:       <target dev="tap71008ce9-f7"/>
Nov 09 02:13:51 user nova-compute[75438]:     </interface>
Nov 09 02:13:51 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:13:51 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/console.log" append="off"/>
Nov 09 02:13:51 user nova-compute[75438]:     </serial>
Nov 09 02:13:51 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:13:51 user nova-compute[75438]:     <video>
Nov 09 02:13:51 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:13:51 user nova-compute[75438]:     </video>
Nov 09 02:13:51 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:13:51 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:13:51 user nova-compute[75438]:     </rng>
Nov 09 02:13:51 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:13:51 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:13:51 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:13:51 user nova-compute[75438]:     </memballoon>
Nov 09 02:13:51 user nova-compute[75438]:   </devices>
Nov 09 02:13:51 user nova-compute[75438]: </domain>
Nov 09 02:13:51 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1762093738',display_name='tempest-VolumesAdminNegativeTest-server-1762093738',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1762093738',id=22,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='826e2b5db9464d15aa10f4f889e9d320',ramdisk_id='',reservation_id='r-6n4ivk6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1041878911',owner_user_name='tempest-VolumesAdminNegativeTest-1041878911-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:50Z,user_data=None,user_id='866048ee57714ee7aae7be2a57102b0a',uuid=256ada78-3695-4784-953b-c57f555a1ee6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converting VIF {"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG os_vif [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bfd1d08-0e54-59b8-b3f1-0ac62fe7314f', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71008ce9-f7, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71008ce9-f7, col_values=(('qos', UUID('44e7b93c-cddc-4f46-a69c-ada74a754734')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71008ce9-f7, col_values=(('external_ids', {'iface-id': '71008ce9-f7e4-454d-bf36-308a4bf08b2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c8:0f', 'vm-uuid': '256ada78-3695-4784-953b-c57f555a1ee6'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5914c0fa-618b-47b1-a68b-7a0b981723a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260]
Nov 09 02:13:52 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260] successful.
Nov 09 02:13:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:52 user nova-compute[75438]: INFO os_vif [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7')
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a9fbc4-a5a4-4689-a13e-68f758af2878]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[18956868-4126-41b4-b0ed-db170a0833c8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:13:52 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:13:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:13:52 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:13:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.510s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] No VIF found with MAC fa:16:3e:33:c8:0f, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b08c7-6f43-47f3-b3ab-5df88c6da2b2]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.network.neutron [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Updated VIF entry in instance network info cache for port 71008ce9-f7e4-454d-bf36-308a4bf08b2a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.network.neutron [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Updating instance_info_cache with network_info: [{"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9336f0fb-cc3e-4e85-b274-a785fa9a3810 req-8fdb4451-9e18-4d27-8558-57136bea794f service nova] Releasing lock "refresh_cache-256ada78-3695-4784-953b-c57f555a1ee6" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSwgIXhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.550s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '23061313163313764', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061313163313764', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.objects.instance [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'flavor' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-ddad052a-dfb3-47a0-92ee-30d73b3d6bf7 req-b524847f-568a-4c22-b0a4-6e778b75ea54 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ddad052a-dfb3-47a0-92ee-30d73b3d6bf7 req-b524847f-568a-4c22-b0a4-6e778b75ea54 service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ddad052a-dfb3-47a0-92ee-30d73b3d6bf7 req-b524847f-568a-4c22-b0a4-6e778b75ea54 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ddad052a-dfb3-47a0-92ee-30d73b3d6bf7 req-b524847f-568a-4c22-b0a4-6e778b75ea54 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-ddad052a-dfb3-47a0-92ee-30d73b3d6bf7 req-b524847f-568a-4c22-b0a4-6e778b75ea54 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:13:53 user nova-compute[75438]: WARNING nova.compute.manager [req-ddad052a-dfb3-47a0-92ee-30d73b3d6bf7 req-b524847f-568a-4c22-b0a4-6e778b75ea54 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state building and task_state spawning.
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:13:53 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:13:53 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:13:53 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:13:53 user nova-compute[75438]:   <serial>f999fdad-7ef1-43cf-9b3a-b6f710ab6efd</serial>
Nov 09 02:13:53 user nova-compute[75438]: </disk>
Nov 09 02:13:53 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:13:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance spawned successfully.
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:53 user nova-compute[75438]: INFO nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 09 02:13:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:13:53 user nova-compute[75438]: INFO nova.compute.manager [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Took 30.52 seconds to build instance.
Nov 09 02:13:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-efb0b53e-45a3-4bfe-9a9b-4e10dc59d7da tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.843s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-a36bd52e-a934-49b5-871a-ee5ea39663da req-3e9617f9-c875-4f87-91a5-de1a47f7cafc service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a36bd52e-a934-49b5-871a-ee5ea39663da req-3e9617f9-c875-4f87-91a5-de1a47f7cafc service nova] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a36bd52e-a934-49b5-871a-ee5ea39663da req-3e9617f9-c875-4f87-91a5-de1a47f7cafc service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a36bd52e-a934-49b5-871a-ee5ea39663da req-3e9617f9-c875-4f87-91a5-de1a47f7cafc service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-a36bd52e-a934-49b5-871a-ee5ea39663da req-3e9617f9-c875-4f87-91a5-de1a47f7cafc service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] No waiting events found dispatching network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:13:54 user nova-compute[75438]: WARNING nova.compute.manager [req-a36bd52e-a934-49b5-871a-ee5ea39663da req-3e9617f9-c875-4f87-91a5-de1a47f7cafc service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received unexpected event network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a for instance with vm_state building and task_state spawning.
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:94:2b:ac, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae672a19-f370-4891-a718-29d82b9a39c2 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.564s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "074d5809-da5f-4158-83e1-651c8518efaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:13:54 user nova-compute[75438]: INFO nova.compute.claims [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Claim successful on node user
Nov 09 02:13:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.763s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:13:55 user nova-compute[75438]: INFO nova.compute.claims [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Claim successful on node user
Nov 09 02:13:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:13:55 user nova-compute[75438]: INFO nova.compute.manager [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Rescuing
Nov 09 02:13:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:13:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:13:55 user nova-compute[75438]: INFO nova.virt.block_device [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Booting with blank volume at /dev/vda
Nov 09 02:13:55 user nova-compute[75438]: DEBUG nova.policy [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3160dcb696a24d3db8bd3a22064cbd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d490c388e64d5fbdeec47eb532482e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-b086c542-c0f1-4ce4-b0b0-c1c5f57aeb7d req-e745b8a9-65b8-4b9b-aaaf-c515df3a3e8c service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b086c542-c0f1-4ce4-b0b0-c1c5f57aeb7d req-e745b8a9-65b8-4b9b-aaaf-c515df3a3e8c service nova] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b086c542-c0f1-4ce4-b0b0-c1c5f57aeb7d req-e745b8a9-65b8-4b9b-aaaf-c515df3a3e8c service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b086c542-c0f1-4ce4-b0b0-c1c5f57aeb7d req-e745b8a9-65b8-4b9b-aaaf-c515df3a3e8c service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-b086c542-c0f1-4ce4-b0b0-c1c5f57aeb7d req-e745b8a9-65b8-4b9b-aaaf-c515df3a3e8c service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] No waiting events found dispatching network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:13:56 user nova-compute[75438]: WARNING nova.compute.manager [req-b086c542-c0f1-4ce4-b0b0-c1c5f57aeb7d req-e745b8a9-65b8-4b9b-aaaf-c515df3a3e8c service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received unexpected event network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a for instance with vm_state building and task_state spawning.
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.882s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:13:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Instance spawned successfully.
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:13:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.policy [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd42bf053761842be974389361ec9f89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b90a39ccf04453387605602fd424452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:13:56 user nova-compute[75438]: INFO nova.virt.block_device [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Booting with volume dcde84f2-18d7-4352-bdcd-969ba7a227ba at /dev/vda
Nov 09 02:13:56 user nova-compute[75438]: INFO nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Took 6.98 seconds to spawn the instance on the hypervisor.
Nov 09 02:13:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:13:56 user nova-compute[75438]: DEBUG os_brick.utils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:13:57 user nova-compute[75438]: INFO nova.compute.manager [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Took 8.09 seconds to build instance.
Nov 09 02:13:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b83938f-b808-4a8e-ba1f-c71dcf05e20e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0c81af33-7c73-4e0e-b750-73b223bccc59 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "256ada78-3695-4784-953b-c57f555a1ee6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.250s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[869e7198-8d9e-4e91-8333-99ee30ca99d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6754e3-4b1d-4f1d-abf6-1138d47263b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a3096-3046-4419-811f-a30f79c8ebc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.network.neutron [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Successfully created port: 3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:13:57 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a79496f-06c4-4d2d-9071-3f08ce36113b]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG os_brick.utils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== get_connector_properties: return (267ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating existing volume attachment record: dc418dae-6296-426e-988a-4cec21c4ef8c {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:13:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance destroyed successfully.
Nov 09 02:13:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Attempting rescue
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75438) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:13:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Creating image(s)
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.297s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue" returned: 0 in 0.091s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.397s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'migration_context' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.objects.base [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Start _get_guest_xml network_info=[{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:94:2b:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'resources' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.objects.base [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:13:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'numa_topology' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.objects.base [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:13:58 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:58 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.objects.base [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2017582046',display_name='tempest-ServerRescueNegativeTestJSON-server-2017582046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2017582046',id=18,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1p/3B+c15jCLdpAkQLerArcyvJcCFaICTi+O31TuA5oQKNx0JzlTlHURY+pMWgl/LUvKYUWiZueWxJGQ7iMmyKEKvZxPV5oIJyvUy79GVwlsEBGGVkupiWcyov7Dv4ng==',key_name='tempest-keypair-544213512',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-jtr2iw2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:11:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:94:2b:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "vif_mac": "fa:16:3e:94:2b:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.objects.base [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Object Instance<7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:13:58 user nova-compute[75438]:   <uuid>7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d</uuid>
Nov 09 02:13:58 user nova-compute[75438]:   <name>instance-00000012</name>
Nov 09 02:13:58 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:13:58 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:13:58 user nova-compute[75438]:   <metadata>
Nov 09 02:13:58 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:13:58 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:13:58 user nova-compute[75438]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2017582046</nova:name>
Nov 09 02:13:58 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:13:58</nova:creationTime>
Nov 09 02:13:58 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:13:58 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:13:58 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:13:58 user nova-compute[75438]:       <nova:owner>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:user uuid="ab1818da0f7a44fe8ae3f9ffce360386">tempest-ServerRescueNegativeTestJSON-655487496-project-member</nova:user>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:project uuid="92bdfa4af42b4c9796dd143f0c4c3da1">tempest-ServerRescueNegativeTestJSON-655487496</nova:project>
Nov 09 02:13:58 user nova-compute[75438]:       </nova:owner>
Nov 09 02:13:58 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:13:58 user nova-compute[75438]:       <nova:ports>
Nov 09 02:13:58 user nova-compute[75438]:         <nova:port uuid="e62b5ee2-b006-48b2-a038-94869d96fc8a">
Nov 09 02:13:58 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:13:58 user nova-compute[75438]:         </nova:port>
Nov 09 02:13:58 user nova-compute[75438]:       </nova:ports>
Nov 09 02:13:58 user nova-compute[75438]:     </nova:instance>
Nov 09 02:13:58 user nova-compute[75438]:   </metadata>
Nov 09 02:13:58 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:13:58 user nova-compute[75438]:     <system>
Nov 09 02:13:58 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:13:58 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:13:58 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:13:58 user nova-compute[75438]:       <entry name="serial">7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d</entry>
Nov 09 02:13:58 user nova-compute[75438]:       <entry name="uuid">7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d</entry>
Nov 09 02:13:58 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:13:58 user nova-compute[75438]:     </system>
Nov 09 02:13:58 user nova-compute[75438]:   </sysinfo>
Nov 09 02:13:58 user nova-compute[75438]:   <os>
Nov 09 02:13:58 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:13:58 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:13:58 user nova-compute[75438]:   </os>
Nov 09 02:13:58 user nova-compute[75438]:   <features>
Nov 09 02:13:58 user nova-compute[75438]:     <acpi/>
Nov 09 02:13:58 user nova-compute[75438]:     <apic/>
Nov 09 02:13:58 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:13:58 user nova-compute[75438]:   </features>
Nov 09 02:13:58 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:13:58 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:13:58 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:13:58 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:13:58 user nova-compute[75438]:   </clock>
Nov 09 02:13:58 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:13:58 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:13:58 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:13:58 user nova-compute[75438]:   </cpu>
Nov 09 02:13:58 user nova-compute[75438]:   <devices>
Nov 09 02:13:58 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:13:58 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:13:58 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue"/>
Nov 09 02:13:58 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:13:58 user nova-compute[75438]:     </disk>
Nov 09 02:13:58 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:13:58 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:13:58 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk"/>
Nov 09 02:13:58 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:13:58 user nova-compute[75438]:     </disk>
Nov 09 02:13:58 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:13:58 user nova-compute[75438]:       <mac address="fa:16:3e:94:2b:ac"/>
Nov 09 02:13:58 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:13:58 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:13:58 user nova-compute[75438]:       <target dev="tape62b5ee2-b0"/>
Nov 09 02:13:58 user nova-compute[75438]:     </interface>
Nov 09 02:13:58 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:13:58 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/console.log" append="off"/>
Nov 09 02:13:58 user nova-compute[75438]:     </serial>
Nov 09 02:13:58 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:13:58 user nova-compute[75438]:     <video>
Nov 09 02:13:58 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:13:58 user nova-compute[75438]:     </video>
Nov 09 02:13:58 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:13:58 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:13:58 user nova-compute[75438]:     </rng>
Nov 09 02:13:58 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:13:58 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:13:58 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:13:58 user nova-compute[75438]:     </memballoon>
Nov 09 02:13:58 user nova-compute[75438]:   </devices>
Nov 09 02:13:58 user nova-compute[75438]: </domain>
Nov 09 02:13:58 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:13:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance destroyed successfully.
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:13:58 user nova-compute[75438]: WARNING nova.compute.manager [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state active and task_state rescuing.
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:13:58 user nova-compute[75438]: WARNING nova.compute.manager [req-3552f247-f858-4ae4-82cb-df32bca71187 req-2cd35e51-36ae-4408-a173-079c1593a02a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state active and task_state rescuing.
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Successfully created port: 2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] No VIF found with MAC fa:16:3e:94:2b:ac, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.network.neutron [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Successfully updated port: 3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.network.neutron [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-changed-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Refreshing instance network info cache due to event network-changed-3de9abc9-2ac0-4e53-926c-bc0731e2c325. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] Acquiring lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:58 user nova-compute[75438]: DEBUG nova.network.neutron [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance network_info: |[{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] Acquired lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Refreshing network info cache for port 3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Successfully updated port: 2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquired lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updated VIF entry in instance network info cache for port 3de9abc9-2ac0-4e53-926c-bc0731e2c325. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-36f0068c-3230-4d4b-80d8-243a95cf61d6 req-ff0fa1ab-a738-48ee-83b0-c56a1626e824 service nova] Releasing lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating instance_info_cache with network_info: [{"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Releasing lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:13:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance network_info: |[{"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-changed-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Refreshing instance network info cache due to event network-changed-2b7ebd43-e9ca-4321-8276-0a43621c89a1. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] Acquiring lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] Acquired lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG nova.network.neutron [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Refreshing network info cache for port 2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:01 user nova-compute[75438]: DEBUG nova.network.neutron [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updated VIF entry in instance network info cache for port 2b7ebd43-e9ca-4321-8276-0a43621c89a1. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:14:01 user nova-compute[75438]: DEBUG nova.network.neutron [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating instance_info_cache with network_info: [{"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9c3a9545-a0c2-4e24-b050-67faf0a0b898 req-cc81c166-fbdd-4817-9a2a-1e63663cdd1d service nova] Releasing lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:02 user nova-compute[75438]: WARNING nova.compute.manager [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state active and task_state rescuing.
Nov 09 02:14:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:02 user nova-compute[75438]: WARNING nova.compute.manager [req-fa11de83-d079-4dbb-a867-e655b62963e6 req-e5f7b6c6-49f3-4208-b71d-a98ac5d4c353 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state active and task_state rescuing.
Nov 09 02:14:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c037ce59-f2f3-487d-8e02-e3aaaaf607ed tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:14:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG os_brick.utils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96096f-f3c9-4941-9267-d953845e64aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[600c4918-1f68-4652-8bf8-76f81bb208fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[932bc7e5-0eeb-4202-bec5-065147deb481]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[084d16d1-e308-45eb-bf9c-e759cfce1eb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:14:06 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:14:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f543e14c-2de9-4374-a4e5-f14400b7bfcf]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG os_brick.utils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:14:06 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating existing volume attachment record: f756f7fa-b235-406d-86cd-8d96ab00094a {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:14:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:10 user nova-compute[75438]: INFO nova.compute.manager [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Terminating instance
Nov 09 02:14:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Instance destroyed successfully.
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lazy-loading 'resources' on Instance uuid b0e68f49-e30d-4530-ae6c-2f3029916a70 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-361849526',display_name='tempest-ServersNegativeTestJSON-server-361849526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-361849526',id=19,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:12:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a44c6747d124716b0bcab5f94ac82f1',ramdisk_id='',reservation_id='r-0zqbk513',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1310159943',owner_user_name='tempest-ServersNegativeTestJSON-1310159943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:12:29Z,user_data=None,user_id='173f61ba6555421b8f09a996aee60807',uuid=b0e68f49-e30d-4530-ae6c-2f3029916a70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converting VIF {"id": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "address": "fa:16:3e:b6:8c:a2", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bb7a744-7e", "ovs_interfaceid": "5bb7a744-7e18-42c0-9f58-22bcb9376aeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG os_vif [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bb7a744-7e, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-92c70848-ea61-441e-af5d-8b359b0fd6e4 req-07280735-44cb-4064-9fc8-9d03e78cf463 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-vif-unplugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-92c70848-ea61-441e-af5d-8b359b0fd6e4 req-07280735-44cb-4064-9fc8-9d03e78cf463 service nova] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-92c70848-ea61-441e-af5d-8b359b0fd6e4 req-07280735-44cb-4064-9fc8-9d03e78cf463 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-92c70848-ea61-441e-af5d-8b359b0fd6e4 req-07280735-44cb-4064-9fc8-9d03e78cf463 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-92c70848-ea61-441e-af5d-8b359b0fd6e4 req-07280735-44cb-4064-9fc8-9d03e78cf463 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] No waiting events found dispatching network-vif-unplugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-92c70848-ea61-441e-af5d-8b359b0fd6e4 req-07280735-44cb-4064-9fc8-9d03e78cf463 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-vif-unplugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f976d048-b447-4085-94d2-c74281e97517) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:11 user nova-compute[75438]: INFO os_vif [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:8c:a2,bridge_name='br-int',has_traffic_filtering=True,id=5bb7a744-7e18-42c0-9f58-22bcb9376aeb,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bb7a744-7e')
Nov 09 02:14:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Deleting instance files /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70_del
Nov 09 02:14:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Deletion of /opt/stack/data/nova/instances/b0e68f49-e30d-4530-ae6c-2f3029916a70_del complete
Nov 09 02:14:11 user nova-compute[75438]: INFO nova.compute.manager [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Took 1.10 seconds to destroy the instance on the hypervisor.
Nov 09 02:14:11 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:14:11 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:14:12 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:12 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Took 1.26 seconds to deallocate network for instance.
Nov 09 02:14:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-a811a047-2509-4031-8a33-363b3fad4d4b req-24908fa4-bf4d-4246-98e5-cc3b6fc0e60e service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-vif-deleted-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-59d8bcf1-8601-41af-9fd3-5e715126a651 req-1f80977d-f187-4cf9-a535-6eb53ad71c25 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received event network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59d8bcf1-8601-41af-9fd3-5e715126a651 req-1f80977d-f187-4cf9-a535-6eb53ad71c25 service nova] Acquiring lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59d8bcf1-8601-41af-9fd3-5e715126a651 req-1f80977d-f187-4cf9-a535-6eb53ad71c25 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59d8bcf1-8601-41af-9fd3-5e715126a651 req-1f80977d-f187-4cf9-a535-6eb53ad71c25 service nova] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-59d8bcf1-8601-41af-9fd3-5e715126a651 req-1f80977d-f187-4cf9-a535-6eb53ad71c25 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] No waiting events found dispatching network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:13 user nova-compute[75438]: WARNING nova.compute.manager [req-59d8bcf1-8601-41af-9fd3-5e715126a651 req-1f80977d-f187-4cf9-a535-6eb53ad71c25 service nova] [instance: b0e68f49-e30d-4530-ae6c-2f3029916a70] Received unexpected event network-vif-plugged-5bb7a744-7e18-42c0-9f58-22bcb9376aeb for instance with vm_state deleted and task_state None.
Nov 09 02:14:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.592s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:13 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Deleted allocations for instance b0e68f49-e30d-4530-ae6c-2f3029916a70
Nov 09 02:14:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4d8cac3-71c1-4b12-8a43-ac121d2693c0 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "b0e68f49-e30d-4530-ae6c-2f3029916a70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.240s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:14:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Creating image(s)
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Ensure instance console log exists: /opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Start _get_guest_xml network_info=[{"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'dc418dae-6296-426e-988a-4cec21c4ef8c', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84a69147-dc3e-4bd3-83e0-4656d2d8ea16', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'serial': 'dcde84f2-18d7-4352-bdcd-969ba7a227ba'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:14:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:14:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:25 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af375d-a44c-4bfb-b924-4075d6777661]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:14:25 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:25 user nova-compute[75438]: INFO nova.compute.manager [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Terminating instance
Nov 09 02:14:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4534c9-83e9-4190-820a-0764669077a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba] added
Nov 09 02:14:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261aad6-2d65-43fe-b0a5-f7daf8e850a1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5709f97-e52b-41af-9d7f-52a59a9a07c5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdcZEqPr {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdcZEqPr" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b86f9-04f5-4c52-a1e5-0bc3aa1980f5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdcZEqPr'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0684b52e-2905-4880-92f6-f6acce9d4dce]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b715f-a2db-4e60-bc12-22e5cdbe7820]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:26 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:26 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f36dad7-4e8f-4ccb-a6de-15567fdaa532]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]
Nov 09 02:14:26 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.
Nov 09 02:14:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55a0d5-fe15-4ec3-983b-10e746ff3276]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[25504890-e432-4b8c-9d5b-645ba3abca0a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:26 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:26 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:26 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:26 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb59ff7-a898-47f5-b22d-3fc0d6e0f052]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-1f1aa16f-5ff7-40a1-8686-cc19d6cb7e56 req-34193797-b150-40eb-8a94-39cd0603c5be service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1f1aa16f-5ff7-40a1-8686-cc19d6cb7e56 req-34193797-b150-40eb-8a94-39cd0603c5be service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1f1aa16f-5ff7-40a1-8686-cc19d6cb7e56 req-34193797-b150-40eb-8a94-39cd0603c5be service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1f1aa16f-5ff7-40a1-8686-cc19d6cb7e56 req-34193797-b150-40eb-8a94-39cd0603c5be service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-1f1aa16f-5ff7-40a1-8686-cc19d6cb7e56 req-34193797-b150-40eb-8a94-39cd0603c5be service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-1f1aa16f-5ff7-40a1-8686-cc19d6cb7e56 req-34193797-b150-40eb-8a94-39cd0603c5be service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-unplugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Instance destroyed successfully.
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.objects.instance [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'resources' on Instance uuid a300e943-2854-4f88-97b1-8d2e2b754f12 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-455427829',display_name='tempest-AttachVolumeTestJSON-server-455427829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-455427829',id=5,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeFx8hwZDJPVLC/7yi2YCZtSmU+lPZ4sU4DPz22Kn34g91zXnfVkUVb/rtk1jDhuNxlz3qmKFPaIURdigzR8UXaCr3ayxGABCQxbC/8c4Usz0m4p7EAc9JjVZMHy8C2IQ==',key_name='tempest-keypair-2013555933',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-tdqjtli6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:12:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=a300e943-2854-4f88-97b1-8d2e2b754f12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "address": "fa:16:3e:81:73:9c", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71877205-b0", "ovs_interfaceid": "71877205-b0ab-456f-a4e1-9e5f638fb7fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG os_vif [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71877205-b0, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85085519-b267-4d44-bce0-ea5384512149) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:26 user nova-compute[75438]: INFO os_vif [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:73:9c,bridge_name='br-int',has_traffic_filtering=True,id=71877205-b0ab-456f-a4e1-9e5f638fb7fc,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71877205-b0')
Nov 09 02:14:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Deleting instance files /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12_del
Nov 09 02:14:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Deletion of /opt/stack/data/nova/instances/a300e943-2854-4f88-97b1-8d2e2b754f12_del complete
Nov 09 02:14:26 user nova-compute[75438]: INFO nova.compute.manager [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:14:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23461663336336461', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461663336336461', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-594334493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-594334493',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5tur4KHsYWmYr5apfE+nTJUUV0P9vgLOi9qtfxKdVRfN7Z/ln6xZmAnG5/s4YQ5a62+x2A+XbtT/mc9SdFYtWXrp+O6WCdeNIwExdi3ksz4Re8DoIPfr3LiQfM71S8A==',key_name='tempest-keypair-959261134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90a39ccf04453387605602fd424452',ramdisk_id='',reservation_id='r-f42cnvuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1084561406',owner_user_name='tempest-ServerActionsV293TestJSON-1084561406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d42bf053761842be974389361ec9f89e',uuid=84a69147-dc3e-4bd3-83e0-4656d2d8ea16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converting VIF {"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lazy-loading 'pci_devices' on Instance uuid 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:14:27 user nova-compute[75438]:   <uuid>84a69147-dc3e-4bd3-83e0-4656d2d8ea16</uuid>
Nov 09 02:14:27 user nova-compute[75438]:   <name>instance-00000017</name>
Nov 09 02:14:27 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:14:27 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:14:27 user nova-compute[75438]:   <metadata>
Nov 09 02:14:27 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:14:27 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:14:27 user nova-compute[75438]:       <nova:name>tempest-ServerActionsV293TestJSON-server-594334493</nova:name>
Nov 09 02:14:27 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:14:25</nova:creationTime>
Nov 09 02:14:27 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:14:27 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:14:27 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:14:27 user nova-compute[75438]:       <nova:owner>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:user uuid="d42bf053761842be974389361ec9f89e">tempest-ServerActionsV293TestJSON-1084561406-project-member</nova:user>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:project uuid="4b90a39ccf04453387605602fd424452">tempest-ServerActionsV293TestJSON-1084561406</nova:project>
Nov 09 02:14:27 user nova-compute[75438]:       </nova:owner>
Nov 09 02:14:27 user nova-compute[75438]:       <nova:ports>
Nov 09 02:14:27 user nova-compute[75438]:         <nova:port uuid="2b7ebd43-e9ca-4321-8276-0a43621c89a1">
Nov 09 02:14:27 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 02:14:27 user nova-compute[75438]:         </nova:port>
Nov 09 02:14:27 user nova-compute[75438]:       </nova:ports>
Nov 09 02:14:27 user nova-compute[75438]:     </nova:instance>
Nov 09 02:14:27 user nova-compute[75438]:   </metadata>
Nov 09 02:14:27 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:14:27 user nova-compute[75438]:     <system>
Nov 09 02:14:27 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:14:27 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:14:27 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:14:27 user nova-compute[75438]:       <entry name="serial">84a69147-dc3e-4bd3-83e0-4656d2d8ea16</entry>
Nov 09 02:14:27 user nova-compute[75438]:       <entry name="uuid">84a69147-dc3e-4bd3-83e0-4656d2d8ea16</entry>
Nov 09 02:14:27 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:14:27 user nova-compute[75438]:     </system>
Nov 09 02:14:27 user nova-compute[75438]:   </sysinfo>
Nov 09 02:14:27 user nova-compute[75438]:   <os>
Nov 09 02:14:27 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:14:27 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:14:27 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:14:27 user nova-compute[75438]:   </os>
Nov 09 02:14:27 user nova-compute[75438]:   <features>
Nov 09 02:14:27 user nova-compute[75438]:     <acpi/>
Nov 09 02:14:27 user nova-compute[75438]:     <apic/>
Nov 09 02:14:27 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:14:27 user nova-compute[75438]:   </features>
Nov 09 02:14:27 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:14:27 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:14:27 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:14:27 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:14:27 user nova-compute[75438]:   </clock>
Nov 09 02:14:27 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:14:27 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:14:27 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:14:27 user nova-compute[75438]:   </cpu>
Nov 09 02:14:27 user nova-compute[75438]:   <devices>
Nov 09 02:14:27 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:14:27 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:14:27 user nova-compute[75438]:       <source dev="/dev/sdd"/>
Nov 09 02:14:27 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:14:27 user nova-compute[75438]:       <serial>dcde84f2-18d7-4352-bdcd-969ba7a227ba</serial>
Nov 09 02:14:27 user nova-compute[75438]:     </disk>
Nov 09 02:14:27 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:14:27 user nova-compute[75438]:       <mac address="fa:16:3e:38:0d:bb"/>
Nov 09 02:14:27 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:27 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:14:27 user nova-compute[75438]:       <target dev="tap2b7ebd43-e9"/>
Nov 09 02:14:27 user nova-compute[75438]:     </interface>
Nov 09 02:14:27 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:14:27 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16/console.log" append="off"/>
Nov 09 02:14:27 user nova-compute[75438]:     </serial>
Nov 09 02:14:27 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:14:27 user nova-compute[75438]:     <video>
Nov 09 02:14:27 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:27 user nova-compute[75438]:     </video>
Nov 09 02:14:27 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:14:27 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:14:27 user nova-compute[75438]:     </rng>
Nov 09 02:14:27 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:14:27 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:14:27 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:14:27 user nova-compute[75438]:     </memballoon>
Nov 09 02:14:27 user nova-compute[75438]:   </devices>
Nov 09 02:14:27 user nova-compute[75438]: </domain>
Nov 09 02:14:27 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-594334493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-594334493',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5tur4KHsYWmYr5apfE+nTJUUV0P9vgLOi9qtfxKdVRfN7Z/ln6xZmAnG5/s4YQ5a62+x2A+XbtT/mc9SdFYtWXrp+O6WCdeNIwExdi3ksz4Re8DoIPfr3LiQfM71S8A==',key_name='tempest-keypair-959261134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b90a39ccf04453387605602fd424452',ramdisk_id='',reservation_id='r-f42cnvuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1084561406',owner_user_name='tempest-ServerActionsV293TestJSON-1084561406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d42bf053761842be974389361ec9f89e',uuid=84a69147-dc3e-4bd3-83e0-4656d2d8ea16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converting VIF {"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG os_vif [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2733f8e-5bb9-5ca4-905c-409539115c67', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b7ebd43-e9, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b7ebd43-e9, col_values=(('qos', UUID('68a08118-f703-4038-98be-96b9e9c042c4')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b7ebd43-e9, col_values=(('external_ids', {'iface-id': '2b7ebd43-e9ca-4321-8276-0a43621c89a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:0d:bb', 'vm-uuid': '84a69147-dc3e-4bd3-83e0-4656d2d8ea16'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:27 user nova-compute[75438]: INFO os_vif [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9')
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:14:27 user nova-compute[75438]: INFO nova.compute.claims [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Claim successful on node user
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] No VIF found with MAC fa:16:3e:38:0d:bb, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:28 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Took 1.61 seconds to deallocate network for instance.
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.013s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.522s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.066s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] Acquiring lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] No waiting events found dispatching network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:28 user nova-compute[75438]: WARNING nova.compute.manager [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received unexpected event network-vif-plugged-71877205-b0ab-456f-a4e1-9e5f638fb7fc for instance with vm_state deleted and task_state None.
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-5a045917-4675-4841-a571-e9408db6227e req-f58cf457-41a7-419e-a895-fe074091dfad service nova] [instance: a300e943-2854-4f88-97b1-8d2e2b754f12] Received event network-vif-deleted-71877205-b0ab-456f-a4e1-9e5f638fb7fc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:14:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.policy [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '784e9264262a4176839b41cd5d296b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0cb190e1d94289bf11c5544f59f729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:14:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Creating image(s)
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "/opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "/opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "/opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.225s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.258s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk 1073741824" returned: 0 in 0.089s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.053s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Successfully created port: afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-cbc5ae30-5286-48fe-98ae-7a043981e3c5 req-213e7565-3260-44ec-9496-613779bb859c service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cbc5ae30-5286-48fe-98ae-7a043981e3c5 req-213e7565-3260-44ec-9496-613779bb859c service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cbc5ae30-5286-48fe-98ae-7a043981e3c5 req-213e7565-3260-44ec-9496-613779bb859c service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cbc5ae30-5286-48fe-98ae-7a043981e3c5 req-213e7565-3260-44ec-9496-613779bb859c service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-cbc5ae30-5286-48fe-98ae-7a043981e3c5 req-213e7565-3260-44ec-9496-613779bb859c service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:29 user nova-compute[75438]: WARNING nova.compute.manager [req-cbc5ae30-5286-48fe-98ae-7a043981e3c5 req-213e7565-3260-44ec-9496-613779bb859c service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state building and task_state spawning.
Nov 09 02:14:29 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Deleted allocations for instance a300e943-2854-4f88-97b1-8d2e2b754f12
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.308s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-735eb8aa-a628-4eab-86b3-fbc46c7a2ea9 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "a300e943-2854-4f88-97b1-8d2e2b754f12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.886s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Cannot resize image /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Ensure instance console log exists: /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Successfully updated port: afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquired lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-changed-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Refreshing instance network info cache due to event network-changed-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:14:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] Acquiring lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wItPByJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:14:31 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:31 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:31 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fbfefd-184e-4ce2-8d1b-fe0c97031775]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:14:31 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aff6c7-1265-4574-8741-da94ecb1ec6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63] added
Nov 09 02:14:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[87da06ed-0b67-4ca5-afd2-5b5457b259f7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0b2965-cd05-4412-a2f2-b77196dcfac9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wItPByJU {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wItPByJU" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a1a8c0-7763-4132-9305-89f648fcc138]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wItPByJU'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating instance_info_cache with network_info: [{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8126cd61-e439-488b-ae67-51271bbdbb1f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Releasing lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Instance network_info: |[{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] Acquired lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.neutron [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Refreshing network info cache for port afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Start _get_guest_xml network_info=[{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:31 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dbcea7-d6f0-4600-b335-a5137338b714]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-472143746',display_name='tempest-TestStampPattern-server-472143746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-472143746',id=25,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVAyDRMwjffSqEHQgor1GlyDLaiutN3jGdYixpZry7+mEwIRl0guCFtbKn75XhCI7/ZvTNaQO6Y0hO50K1IkCzCXsM8x/dTz4eGhUYnuIbnYN3L7sdNfCDhQ16Ix2+1ug==',key_name='tempest-TestStampPattern-1748362078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0cb190e1d94289bf11c5544f59f729',ramdisk_id='',reservation_id='r-wu7vj0d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-124162614',owner_user_name='tempest-TestStampPattern-124162614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:14:29Z,user_data=None,user_id='784e9264262a4176839b41cd5d296b94',uuid=350eb030-6104-46bb-9ffe-da6dcb7244ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converting VIF {"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.objects.instance [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'pci_devices' on Instance uuid 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81373a6-e831-4fe5-8fd7-ba0619128208]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260]
Nov 09 02:14:31 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260] successful.
Nov 09 02:14:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:14:31 user nova-compute[75438]:   <uuid>350eb030-6104-46bb-9ffe-da6dcb7244ee</uuid>
Nov 09 02:14:31 user nova-compute[75438]:   <name>instance-00000019</name>
Nov 09 02:14:31 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:14:31 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:14:31 user nova-compute[75438]:   <metadata>
Nov 09 02:14:31 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:14:31 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:14:31 user nova-compute[75438]:       <nova:name>tempest-TestStampPattern-server-472143746</nova:name>
Nov 09 02:14:31 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:14:31</nova:creationTime>
Nov 09 02:14:31 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:14:31 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:14:31 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:14:31 user nova-compute[75438]:       <nova:owner>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:user uuid="784e9264262a4176839b41cd5d296b94">tempest-TestStampPattern-124162614-project-member</nova:user>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:project uuid="af0cb190e1d94289bf11c5544f59f729">tempest-TestStampPattern-124162614</nova:project>
Nov 09 02:14:31 user nova-compute[75438]:       </nova:owner>
Nov 09 02:14:31 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:14:31 user nova-compute[75438]:       <nova:ports>
Nov 09 02:14:31 user nova-compute[75438]:         <nova:port uuid="afa7dc68-4325-4ee5-96f3-4b7a2dad9e07">
Nov 09 02:14:31 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 02:14:31 user nova-compute[75438]:         </nova:port>
Nov 09 02:14:31 user nova-compute[75438]:       </nova:ports>
Nov 09 02:14:31 user nova-compute[75438]:     </nova:instance>
Nov 09 02:14:31 user nova-compute[75438]:   </metadata>
Nov 09 02:14:31 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:14:31 user nova-compute[75438]:     <system>
Nov 09 02:14:31 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:14:31 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:14:31 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:14:31 user nova-compute[75438]:       <entry name="serial">350eb030-6104-46bb-9ffe-da6dcb7244ee</entry>
Nov 09 02:14:31 user nova-compute[75438]:       <entry name="uuid">350eb030-6104-46bb-9ffe-da6dcb7244ee</entry>
Nov 09 02:14:31 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:14:31 user nova-compute[75438]:     </system>
Nov 09 02:14:31 user nova-compute[75438]:   </sysinfo>
Nov 09 02:14:31 user nova-compute[75438]:   <os>
Nov 09 02:14:31 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:14:31 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:14:31 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:14:31 user nova-compute[75438]:   </os>
Nov 09 02:14:31 user nova-compute[75438]:   <features>
Nov 09 02:14:31 user nova-compute[75438]:     <acpi/>
Nov 09 02:14:31 user nova-compute[75438]:     <apic/>
Nov 09 02:14:31 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:14:31 user nova-compute[75438]:   </features>
Nov 09 02:14:31 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:14:31 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:14:31 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:14:31 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:14:31 user nova-compute[75438]:   </clock>
Nov 09 02:14:31 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:14:31 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:14:31 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:14:31 user nova-compute[75438]:   </cpu>
Nov 09 02:14:31 user nova-compute[75438]:   <devices>
Nov 09 02:14:31 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:14:31 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:14:31 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk"/>
Nov 09 02:14:31 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:14:31 user nova-compute[75438]:     </disk>
Nov 09 02:14:31 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:14:31 user nova-compute[75438]:       <mac address="fa:16:3e:86:53:45"/>
Nov 09 02:14:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:31 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:14:31 user nova-compute[75438]:       <target dev="tapafa7dc68-43"/>
Nov 09 02:14:31 user nova-compute[75438]:     </interface>
Nov 09 02:14:31 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:14:31 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/console.log" append="off"/>
Nov 09 02:14:31 user nova-compute[75438]:     </serial>
Nov 09 02:14:31 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:14:31 user nova-compute[75438]:     <video>
Nov 09 02:14:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:31 user nova-compute[75438]:     </video>
Nov 09 02:14:31 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:14:31 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:14:31 user nova-compute[75438]:     </rng>
Nov 09 02:14:31 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:14:31 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:14:31 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:14:31 user nova-compute[75438]:     </memballoon>
Nov 09 02:14:31 user nova-compute[75438]:   </devices>
Nov 09 02:14:31 user nova-compute[75438]: </domain>
Nov 09 02:14:31 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-472143746',display_name='tempest-TestStampPattern-server-472143746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-472143746',id=25,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVAyDRMwjffSqEHQgor1GlyDLaiutN3jGdYixpZry7+mEwIRl0guCFtbKn75XhCI7/ZvTNaQO6Y0hO50K1IkCzCXsM8x/dTz4eGhUYnuIbnYN3L7sdNfCDhQ16Ix2+1ug==',key_name='tempest-TestStampPattern-1748362078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0cb190e1d94289bf11c5544f59f729',ramdisk_id='',reservation_id='r-wu7vj0d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-124162614',owner_user_name='tempest-TestStampPattern-124162614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:14:29Z,user_data=None,user_id='784e9264262a4176839b41cd5d296b94',uuid=350eb030-6104-46bb-9ffe-da6dcb7244ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converting VIF {"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_vif [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-da1ac25d-db3f-4501-9bf8-49f274d85b49 req-dd129798-1ef1-42c3-b258-b79ac09b0348 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-da1ac25d-db3f-4501-9bf8-49f274d85b49 req-dd129798-1ef1-42c3-b258-b79ac09b0348 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-da1ac25d-db3f-4501-9bf8-49f274d85b49 req-dd129798-1ef1-42c3-b258-b79ac09b0348 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-da1ac25d-db3f-4501-9bf8-49f274d85b49 req-dd129798-1ef1-42c3-b258-b79ac09b0348 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-da1ac25d-db3f-4501-9bf8-49f274d85b49 req-dd129798-1ef1-42c3-b258-b79ac09b0348 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:31 user nova-compute[75438]: WARNING nova.compute.manager [req-da1ac25d-db3f-4501-9bf8-49f274d85b49 req-dd129798-1ef1-42c3-b258-b79ac09b0348 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state building and task_state spawning.
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c02a0ba-2dfe-509c-9986-76349e82b04a', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c4a26-c12f-445d-9a4a-92c0777786d9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafa7dc68-43, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafa7dc68-43, col_values=(('qos', UUID('25ad5a32-ef17-4b33-90f3-ce40c882145d')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafa7dc68-43, col_values=(('external_ids', {'iface-id': 'afa7dc68-4325-4ee5-96f3-4b7a2dad9e07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:53:45', 'vm-uuid': '350eb030-6104-46bb-9ffe-da6dcb7244ee'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bd11c3-31f7-4a85-9961-1896a75c069f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: INFO os_vif [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43')
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:31 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.563s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b0011e-0996-47e8-8973-8ee326004e74]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wItPByJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No VIF found with MAC fa:16:3e:86:53:45, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updated VIF entry in instance network info cache for port afa7dc68-4325-4ee5-96f3-4b7a2dad9e07. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating instance_info_cache with network_info: [{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4195b259-84a5-4911-adc8-cdc4ddb6d4b6 req-548894d3-9b51-4ed3-80af-3cb9c613261b service nova] Releasing lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:14:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance spawned successfully.
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:32 user nova-compute[75438]: INFO nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:14:32 user nova-compute[75438]: INFO nova.compute.manager [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Took 38.12 seconds to build instance.
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2431596f-6416-40ae-b3da-5ee7d1a1e433 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.258s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'flavor' on Instance uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.129s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.654s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] <== connect_volume: return (1656ms) {'type': 'block', 'scsi_wwn': '26237623632343638', 'path': '/dev/sde'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237623632343638', 'path': '/dev/sde'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'flavor' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:14:32 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:14:32 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:14:32 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:14:32 user nova-compute[75438]:   <serial>5a9cc239-1892-42d3-9b7b-846500825f63</serial>
Nov 09 02:14:32 user nova-compute[75438]: </disk>
Nov 09 02:14:32 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:33 user nova-compute[75438]: INFO nova.compute.manager [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attaching volume bc1e01dc-86c0-473d-a4a5-d1509479d43a to /dev/vdb
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.276s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG os_brick.utils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7747bf90-2afb-428c-adc6-cd6c08d9ba87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff193053-b6b8-4339-ba06-3f3e74e035e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2adaac4-87f1-45f3-803e-7cd49eb067b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[674b048b-f9a8-4343-8ed1-11efcaec18fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:14:33 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc34322a-9eb1-43f8-9fde-09ba77fdc382]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG os_brick.utils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updating existing volume attachment record: ca0678ae-c04d-4a17-bb78-8fe1177eb3b2 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-changed-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Refreshing instance network info cache due to event network-changed-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] Acquiring lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] Acquired lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.network.neutron [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Refreshing network info cache for port 40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No VIF found with MAC fa:16:3e:7d:5e:ef, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e7ba44b1-5a6f-4893-b14b-734ce69c8aaf tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 81.592s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-940af928-cd69-4a5f-8a53-c9b0b17f0272 req-578b4cf3-0231-40c1-8215-6e5e3918a0d4 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-940af928-cd69-4a5f-8a53-c9b0b17f0272 req-578b4cf3-0231-40c1-8215-6e5e3918a0d4 service nova] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-940af928-cd69-4a5f-8a53-c9b0b17f0272 req-578b4cf3-0231-40c1-8215-6e5e3918a0d4 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-940af928-cd69-4a5f-8a53-c9b0b17f0272 req-578b4cf3-0231-40c1-8215-6e5e3918a0d4 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-940af928-cd69-4a5f-8a53-c9b0b17f0272 req-578b4cf3-0231-40c1-8215-6e5e3918a0d4 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] No waiting events found dispatching network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:34 user nova-compute[75438]: WARNING nova.compute.manager [req-940af928-cd69-4a5f-8a53-c9b0b17f0272 req-578b4cf3-0231-40c1-8215-6e5e3918a0d4 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received unexpected event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 for instance with vm_state building and task_state spawning.
Nov 09 02:14:34 user nova-compute[75438]: DEBUG nova.network.neutron [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updated VIF entry in instance network info cache for port 40acfb20-c0f4-47b9-a8c5-87cec6f4f24f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG nova.network.neutron [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updating instance_info_cache with network_info: [{"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-497ec287-5da9-434e-8440-1b4552ccc335 req-0246054e-8f46-41e5-86b0-523ffdbeb77b service nova] Releasing lock "refresh_cache-a3b47518-63f5-4a38-834d-5627bec3892d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json" returned: 0 in 0.302s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:35 user nova-compute[75438]: INFO nova.compute.manager [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Rescuing
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=25.070384979248047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc3273e2-ade3-49dc-ba5b-77ec90a0069b req-c72e116c-abba-4d78-8e15-730e6873cb1c service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc3273e2-ade3-49dc-ba5b-77ec90a0069b req-c72e116c-abba-4d78-8e15-730e6873cb1c service nova] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc3273e2-ade3-49dc-ba5b-77ec90a0069b req-c72e116c-abba-4d78-8e15-730e6873cb1c service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc3273e2-ade3-49dc-ba5b-77ec90a0069b req-c72e116c-abba-4d78-8e15-730e6873cb1c service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc3273e2-ade3-49dc-ba5b-77ec90a0069b req-c72e116c-abba-4d78-8e15-730e6873cb1c service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] No waiting events found dispatching network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:36 user nova-compute[75438]: WARNING nova.compute.manager [req-dc3273e2-ade3-49dc-ba5b-77ec90a0069b req-c72e116c-abba-4d78-8e15-730e6873cb1c service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received unexpected event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 for instance with vm_state building and task_state spawning.
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:14:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Creating image(s)
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Ensure instance console log exists: /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Start _get_guest_xml network_info=[{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'f756f7fa-b235-406d-86cd-8d96ab00094a', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '074d5809-da5f-4158-83e1-651c8518efaa', 'attached_at': '', 'detached_at': '', 'volume_id': '3b7a65b1-5262-4943-b932-ae673dbf5d13', 'serial': '3b7a65b1-5262-4943-b932-ae673dbf5d13'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a3b47518-63f5-4a38-834d-5627bec3892d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 896758d5-8945-4fb7-a90f-a86084c7fd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 256ada78-3695-4784-953b-c57f555a1ee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:14:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:14:36 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:36 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:36 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d3772-7f0d-4e32-99ce-4595ddc98396]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:14:36 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:14:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Instance spawned successfully.
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d05a56b-c2b9-4f77-86c4-c79ef6557ccc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13] added
Nov 09 02:14:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11abfa55-77b8-4339-8656-08baf07ad6a7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ad2d4-0a2b-49bf-9d27-396a19074a03]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZIcvDzU {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZIcvDzU" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db61b15-e643-4684-a1f0-f6d4d4fe003b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pZIcvDzU'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcbba2d-bd50-4847-b271-4abb8db82c79]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: INFO nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Took 8.26 seconds to spawn the instance on the hypervisor.
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.050s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e5a7c4-ed12-4aa8-bbdf-2bb68b16e90c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --login" returned: 0 in 0.115s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948ea46-07fc-4841-bf8f-08e74b280ff6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260]
Nov 09 02:14:37 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260] successful.
Nov 09 02:14:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:37 user nova-compute[75438]: INFO nova.compute.manager [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Took 9.83 seconds to build instance.
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ba034dc-1a87-4fc1-9035-b4fe954537bf tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.032s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c028097f-f7f7-4b43-bdd6-a076ca1e6769]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-927679fe-180c-4c86-9576-df7bff349117 req-a2c25379-d87d-4370-9ab8-3f7d7bd98aab service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-927679fe-180c-4c86-9576-df7bff349117 req-a2c25379-d87d-4370-9ab8-3f7d7bd98aab service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-927679fe-180c-4c86-9576-df7bff349117 req-a2c25379-d87d-4370-9ab8-3f7d7bd98aab service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-927679fe-180c-4c86-9576-df7bff349117 req-a2c25379-d87d-4370-9ab8-3f7d7bd98aab service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-927679fe-180c-4c86-9576-df7bff349117 req-a2c25379-d87d-4370-9ab8-3f7d7bd98aab service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:37 user nova-compute[75438]: WARNING nova.compute.manager [req-927679fe-180c-4c86-9576-df7bff349117 req-a2c25379-d87d-4370-9ab8-3f7d7bd98aab service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state active and task_state rescuing.
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ebdc7-4469-4633-87fa-c1cc046d9f40]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:14:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.486s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0011470-707c-4657-996d-5b5bcf5d7c04]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.043s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance destroyed successfully.
Nov 09 02:14:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Attempting a stable device rescue
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75438) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:14:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Creating image(s)
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "c1c8b9b1ae291f93c409add4475d13a30decfead" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "c1c8b9b1ae291f93c409add4475d13a30decfead" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.447s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== connect_volume: return (2450ms) {'type': 'block', 'scsi_wwn': '23662616366633332', 'path': '/dev/sdf'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662616366633332', 'path': '/dev/sdf'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1756521678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1756521678',id=24,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-83kov24h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:56Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=074d5809-da5f-4158-83e1-651c8518efaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'pci_devices' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:14:39 user nova-compute[75438]:   <uuid>074d5809-da5f-4158-83e1-651c8518efaa</uuid>
Nov 09 02:14:39 user nova-compute[75438]:   <name>instance-00000018</name>
Nov 09 02:14:39 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:14:39 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:14:39 user nova-compute[75438]:   <metadata>
Nov 09 02:14:39 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:14:39 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:14:39 user nova-compute[75438]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1756521678</nova:name>
Nov 09 02:14:39 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:14:36</nova:creationTime>
Nov 09 02:14:39 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:14:39 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:14:39 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:14:39 user nova-compute[75438]:       <nova:owner>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:user uuid="3160dcb696a24d3db8bd3a22064cbd7a">tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member</nova:user>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:project uuid="f7d490c388e64d5fbdeec47eb532482e">tempest-ServerBootFromVolumeStableRescueTest-1794136160</nova:project>
Nov 09 02:14:39 user nova-compute[75438]:       </nova:owner>
Nov 09 02:14:39 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:14:39 user nova-compute[75438]:       <nova:ports>
Nov 09 02:14:39 user nova-compute[75438]:         <nova:port uuid="3de9abc9-2ac0-4e53-926c-bc0731e2c325">
Nov 09 02:14:39 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:14:39 user nova-compute[75438]:         </nova:port>
Nov 09 02:14:39 user nova-compute[75438]:       </nova:ports>
Nov 09 02:14:39 user nova-compute[75438]:     </nova:instance>
Nov 09 02:14:39 user nova-compute[75438]:   </metadata>
Nov 09 02:14:39 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:14:39 user nova-compute[75438]:     <system>
Nov 09 02:14:39 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:14:39 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:14:39 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:14:39 user nova-compute[75438]:       <entry name="serial">074d5809-da5f-4158-83e1-651c8518efaa</entry>
Nov 09 02:14:39 user nova-compute[75438]:       <entry name="uuid">074d5809-da5f-4158-83e1-651c8518efaa</entry>
Nov 09 02:14:39 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:14:39 user nova-compute[75438]:     </system>
Nov 09 02:14:39 user nova-compute[75438]:   </sysinfo>
Nov 09 02:14:39 user nova-compute[75438]:   <os>
Nov 09 02:14:39 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:14:39 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:14:39 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:14:39 user nova-compute[75438]:   </os>
Nov 09 02:14:39 user nova-compute[75438]:   <features>
Nov 09 02:14:39 user nova-compute[75438]:     <acpi/>
Nov 09 02:14:39 user nova-compute[75438]:     <apic/>
Nov 09 02:14:39 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:14:39 user nova-compute[75438]:   </features>
Nov 09 02:14:39 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:14:39 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:14:39 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:14:39 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:14:39 user nova-compute[75438]:   </clock>
Nov 09 02:14:39 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:14:39 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:14:39 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:14:39 user nova-compute[75438]:   </cpu>
Nov 09 02:14:39 user nova-compute[75438]:   <devices>
Nov 09 02:14:39 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:14:39 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:14:39 user nova-compute[75438]:       <source dev="/dev/sdf"/>
Nov 09 02:14:39 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:14:39 user nova-compute[75438]:       <serial>3b7a65b1-5262-4943-b932-ae673dbf5d13</serial>
Nov 09 02:14:39 user nova-compute[75438]:     </disk>
Nov 09 02:14:39 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:14:39 user nova-compute[75438]:       <mac address="fa:16:3e:be:3b:a4"/>
Nov 09 02:14:39 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:39 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:14:39 user nova-compute[75438]:       <target dev="tap3de9abc9-2a"/>
Nov 09 02:14:39 user nova-compute[75438]:     </interface>
Nov 09 02:14:39 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:14:39 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/console.log" append="off"/>
Nov 09 02:14:39 user nova-compute[75438]:     </serial>
Nov 09 02:14:39 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:14:39 user nova-compute[75438]:     <video>
Nov 09 02:14:39 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:39 user nova-compute[75438]:     </video>
Nov 09 02:14:39 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:14:39 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:14:39 user nova-compute[75438]:     </rng>
Nov 09 02:14:39 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:14:39 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:14:39 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:14:39 user nova-compute[75438]:     </memballoon>
Nov 09 02:14:39 user nova-compute[75438]:   </devices>
Nov 09 02:14:39 user nova-compute[75438]: </domain>
Nov 09 02:14:39 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1756521678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1756521678',id=24,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-83kov24h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:13:56Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=074d5809-da5f-4158-83e1-651c8518efaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG os_vif [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e213a64-16db-485e-91ce-8bcd64bc8353 req-2969b92e-b619-4f7a-90e9-82469ae77ac2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e213a64-16db-485e-91ce-8bcd64bc8353 req-2969b92e-b619-4f7a-90e9-82469ae77ac2 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e213a64-16db-485e-91ce-8bcd64bc8353 req-2969b92e-b619-4f7a-90e9-82469ae77ac2 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e213a64-16db-485e-91ce-8bcd64bc8353 req-2969b92e-b619-4f7a-90e9-82469ae77ac2 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e213a64-16db-485e-91ce-8bcd64bc8353 req-2969b92e-b619-4f7a-90e9-82469ae77ac2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:39 user nova-compute[75438]: WARNING nova.compute.manager [req-4e213a64-16db-485e-91ce-8bcd64bc8353 req-2969b92e-b619-4f7a-90e9-82469ae77ac2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state active and task_state rescuing.
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c63a3206-2dbc-5594-861b-25008cc61dbb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de9abc9-2a, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de9abc9-2a, col_values=(('qos', UUID('fba1935c-aac0-4338-aa7f-6f302b9dc99d')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de9abc9-2a, col_values=(('external_ids', {'iface-id': '3de9abc9-2ac0-4e53-926c-bc0731e2c325', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:3b:a4', 'vm-uuid': '074d5809-da5f-4158-83e1-651c8518efaa'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:39 user nova-compute[75438]: INFO os_vif [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a')
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.part --force-share --output=json" returned: 0 in 0.269s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.images [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] 29c0e18c-6efb-430c-8e9d-216b855c6ecb was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.part /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No VIF found with MAC fa:16:3e:be:3b:a4, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.part /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.converted" returned: 0 in 0.363s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead.converted --force-share --output=json" returned: 0 in 0.267s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "c1c8b9b1ae291f93c409add4475d13a30decfead" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.147s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "c1c8b9b1ae291f93c409add4475d13a30decfead" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "c1c8b9b1ae291f93c409add4475d13a30decfead" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead,backing_fmt=raw /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead,backing_fmt=raw /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue" returned: 0 in 0.054s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "c1c8b9b1ae291f93c409add4475d13a30decfead" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'migration_context' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Object Instance<f2c26e99-e089-49f5-9499-6bf035067512> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Start _get_guest_xml network_info=[{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "vif_mac": "fa:16:3e:7d:5e:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '29c0e18c-6efb-430c-8e9d-216b855c6ecb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '620c846c-6c68-4f6d-84d3-4fcefceec7cc', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wItPByJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f2c26e99-e089-49f5-9499-6bf035067512', 'attached_at': '', 'detached_at': '', 'volume_id': '5a9cc239-1892-42d3-9b7b-846500825f63', 'serial': '5a9cc239-1892-42d3-9b7b-846500825f63'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'resources' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Object Instance<f2c26e99-e089-49f5-9499-6bf035067512> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'numa_topology' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Object Instance<f2c26e99-e089-49f5-9499-6bf035067512> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:14:40 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:40 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Object Instance<f2c26e99-e089-49f5-9499-6bf035067512> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wItPByJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:14:40 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:40 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:14:40 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2391aad4-cd54-4f25-aa47-fe34d9939ae3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wItPByJU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 02:14:40 user nova-compute[75438]: node.name = iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:14:40 user nova-compute[75438]: node.tpgt = -1
Nov 09 02:14:40 user nova-compute[75438]: node.startup = automatic
Nov 09 02:14:40 user nova-compute[75438]: node.leading_login = No
Nov 09 02:14:40 user nova-compute[75438]: iface.iscsi_ifacename = default
Nov 09 02:14:40 user nova-compute[75438]: iface.net_ifacename = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.ipaddress = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.prefix_len = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.hwaddress = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.transport_name = tcp
Nov 09 02:14:40 user nova-compute[75438]: iface.initiatorname = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.vlan_id = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.vlan_priority = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.vlan_state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.iface_num = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.mtu = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.port = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.bootproto = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.subnet_mask = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.gateway = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_alt_client_id = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_dns = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_learn_iqn = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_vendor_id_state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_vendor_id = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.dhcp_slp_da = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.fragmentation = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.gratuitous_arp = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.incoming_forwarding = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.tos_state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.tos = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.ttl = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.delayed_ack = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.tcp_nagle = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.tcp_wsf_state = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.tcp_wsf = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.tcp_timer_scale = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.tcp_timestamp = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.redirect = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.def_task_mgmt_timeout = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.header_digest = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.data_digest = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.immediate_data = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.initial_r2t = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.data_seq_inorder = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.data_pdu_inorder = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.erl = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.max_receive_data_len = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.first_burst_len = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.max_outstanding_r2t = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.max_burst_len = 0
Nov 09 02:14:40 user nova-compute[75438]: iface.chap_auth = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.bidi_chap = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.strict_login_compliance = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.discovery_auth = <empty>
Nov 09 02:14:40 user nova-compute[75438]: iface.discovery_logout = <empty>
Nov 09 02:14:40 user nova-compute[75438]: node.discovery_address = <empty>
Nov 09 02:14:40 user nova-compute[75438]: node.discovery_port = 0
Nov 09 02:14:40 user nova-compute[75438]: node.discovery_type = static
Nov 09 02:14:40 user nova-compute[75438]: node.session.initial_cmdsn = 0
Nov 09 02:14:40 user nova-compute[75438]: node.session.initial_login_retry_max = 8
Nov 09 02:14:40 user nova-compute[75438]: node.session.xmit_thread_priority = -20
Nov 09 02:14:40 user nova-compute[75438]: node.session.cmds_max = 128
Nov 09 02:14:40 user nova-compute[75438]: node.session.queue_depth = 32
Nov 09 02:14:40 user nova-compute[75438]: node.session.nr_sessions = 1
Nov 09 02:14:40 user nova-compute[75438]: node.session.auth.authmethod = CHAP
Nov 09 02:14:40 user nova-compute[75438]: node.session.auth.username = wItPByJU
Nov 09 02:14:40 user nova-compute[75438]: node.session.auth.password = ***
Nov 09 02:14:40 user nova-compute[75438]: node.session.auth.username_in = <empty>
Nov 09 02:14:40 user nova-compute[75438]: node.session.auth.password_in = <empty>
Nov 09 02:14:40 user nova-compute[75438]: node.session.auth.chap_algs = MD5
Nov 09 02:14:40 user nova-compute[75438]: node.session.timeo.replacement_timeout = 120
Nov 09 02:14:40 user nova-compute[75438]: node.session.err_timeo.abort_timeout = 15
Nov 09 02:14:40 user nova-compute[75438]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 02:14:40 user nova-compute[75438]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 02:14:40 user nova-compute[75438]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.FastAbort = Yes
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.InitialR2T = No
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.ImmediateData = Yes
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.MaxConnections = 1
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 02:14:40 user nova-compute[75438]: node.session.iscsi.ERL = 0
Nov 09 02:14:40 user nova-compute[75438]: node.session.scan = manual
Nov 09 02:14:40 user nova-compute[75438]: node.session.reopen_max = 0
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].address = 172.16.0.220
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].port = 3260
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].startup = manual
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].tcp.window_size = 524288
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].tcp.type_of_service = 0
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].timeo.logout_timeout = 15
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].timeo.login_timeout = 15
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].timeo.auth_timeout = 45
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].iscsi.DataDigest = None
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].iscsi.IFMarker = No
Nov 09 02:14:40 user nova-compute[75438]: node.conn[0].iscsi.OFMarker = No
Nov 09 02:14:40 user nova-compute[75438]: # END RECORD
Nov 09 02:14:40 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc5df2f-e8d9-4457-840c-4d8db463695f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d48ac0f-9e3c-4437-87cd-2211cd81afd3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wItPByJU {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wItPByJU" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1546706c-94da-4096-9a8b-122dddfd9403]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wItPByJU'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df65ea-f1c0-417f-bcfc-a579b8c5a8ac]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a57568-6178-44c6-9b9b-38a44c4bf632]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:14:40 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:14:40 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:14:40 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.188s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] HCTL ('36', '0', '0', 0) found on session 24 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[da73bbe1-127c-4d69-9824-f1762b0abc03]: (4, ('0 0 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Searching for a device in session 24 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wItPByJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.215s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] <== connect_volume: return (217ms) {'type': 'block', 'scsi_wwn': '26237623632343638', 'path': '/dev/sde'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237623632343638', 'path': '/dev/sde'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1933050020',display_name='tempest-ServerStableDeviceRescueTest-server-1933050020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1933050020',id=14,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKDpuWXe8laBaRb9YE1a4T307OlX9DrMSCdp2D+FiV3QrJsddtQiEFNfKYtruYEV/Te6PBx6sTuKx1fNq7XM5ic/fY3vZT/Ur/1hc/vA6eRDgpCFt7xwG0WlMZpFLqUvA==',key_name='tempest-keypair-1023383383',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e41745ea4d9482b8bf124615afcf332',ramdisk_id='',reservation_id='r-ar1gm8na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1045361722',owner_user_name='tempest-ServerStableDeviceRescueTest-1045361722-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:11:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d603c6cb567c414a9c1fef7259b0f124',uuid=f2c26e99-e089-49f5-9499-6bf035067512,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "vif_mac": "fa:16:3e:7d:5e:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converting VIF {"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "vif_mac": "fa:16:3e:7d:5e:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'pci_devices' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Object Instance<f2c26e99-e089-49f5-9499-6bf035067512> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:14:40 user nova-compute[75438]:   <uuid>f2c26e99-e089-49f5-9499-6bf035067512</uuid>
Nov 09 02:14:40 user nova-compute[75438]:   <name>instance-0000000e</name>
Nov 09 02:14:40 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:14:40 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:14:40 user nova-compute[75438]:   <metadata>
Nov 09 02:14:40 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:14:40 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:14:40 user nova-compute[75438]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1933050020</nova:name>
Nov 09 02:14:40 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:14:40</nova:creationTime>
Nov 09 02:14:40 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:14:40 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:14:40 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:14:40 user nova-compute[75438]:       <nova:owner>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:user uuid="d603c6cb567c414a9c1fef7259b0f124">tempest-ServerStableDeviceRescueTest-1045361722-project-member</nova:user>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:project uuid="1e41745ea4d9482b8bf124615afcf332">tempest-ServerStableDeviceRescueTest-1045361722</nova:project>
Nov 09 02:14:40 user nova-compute[75438]:       </nova:owner>
Nov 09 02:14:40 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:14:40 user nova-compute[75438]:       <nova:ports>
Nov 09 02:14:40 user nova-compute[75438]:         <nova:port uuid="3ab12034-c674-490a-be6d-db79cecc5b53">
Nov 09 02:14:40 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:14:40 user nova-compute[75438]:         </nova:port>
Nov 09 02:14:40 user nova-compute[75438]:       </nova:ports>
Nov 09 02:14:40 user nova-compute[75438]:     </nova:instance>
Nov 09 02:14:40 user nova-compute[75438]:   </metadata>
Nov 09 02:14:40 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:14:40 user nova-compute[75438]:     <system>
Nov 09 02:14:40 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:14:40 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:14:40 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:14:40 user nova-compute[75438]:       <entry name="serial">f2c26e99-e089-49f5-9499-6bf035067512</entry>
Nov 09 02:14:40 user nova-compute[75438]:       <entry name="uuid">f2c26e99-e089-49f5-9499-6bf035067512</entry>
Nov 09 02:14:40 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:14:40 user nova-compute[75438]:     </system>
Nov 09 02:14:40 user nova-compute[75438]:   </sysinfo>
Nov 09 02:14:40 user nova-compute[75438]:   <os>
Nov 09 02:14:40 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:14:40 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:14:40 user nova-compute[75438]:   </os>
Nov 09 02:14:40 user nova-compute[75438]:   <features>
Nov 09 02:14:40 user nova-compute[75438]:     <acpi/>
Nov 09 02:14:40 user nova-compute[75438]:     <apic/>
Nov 09 02:14:40 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:14:40 user nova-compute[75438]:   </features>
Nov 09 02:14:40 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:14:40 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:14:40 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:14:40 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:14:40 user nova-compute[75438]:   </clock>
Nov 09 02:14:40 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:14:40 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:14:40 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:14:40 user nova-compute[75438]:   </cpu>
Nov 09 02:14:40 user nova-compute[75438]:   <devices>
Nov 09 02:14:40 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:14:40 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:14:40 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk"/>
Nov 09 02:14:40 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:14:40 user nova-compute[75438]:     </disk>
Nov 09 02:14:40 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:14:40 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:14:40 user nova-compute[75438]:       <source dev="/dev/sde"/>
Nov 09 02:14:40 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:14:40 user nova-compute[75438]:       <serial>5a9cc239-1892-42d3-9b7b-846500825f63</serial>
Nov 09 02:14:40 user nova-compute[75438]:     </disk>
Nov 09 02:14:40 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:14:40 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:14:40 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue"/>
Nov 09 02:14:40 user nova-compute[75438]:       <target dev="vdc" bus="virtio"/>
Nov 09 02:14:40 user nova-compute[75438]:       <boot order="1"/>
Nov 09 02:14:40 user nova-compute[75438]:     </disk>
Nov 09 02:14:40 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:14:40 user nova-compute[75438]:       <mac address="fa:16:3e:7d:5e:ef"/>
Nov 09 02:14:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:40 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:14:40 user nova-compute[75438]:       <target dev="tap3ab12034-c6"/>
Nov 09 02:14:40 user nova-compute[75438]:     </interface>
Nov 09 02:14:40 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:14:40 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/console.log" append="off"/>
Nov 09 02:14:40 user nova-compute[75438]:     </serial>
Nov 09 02:14:40 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:14:40 user nova-compute[75438]:     <video>
Nov 09 02:14:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:14:40 user nova-compute[75438]:     </video>
Nov 09 02:14:40 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:14:40 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:14:40 user nova-compute[75438]:     </rng>
Nov 09 02:14:40 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:14:40 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:14:40 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:14:40 user nova-compute[75438]:     </memballoon>
Nov 09 02:14:40 user nova-compute[75438]:   </devices>
Nov 09 02:14:40 user nova-compute[75438]: </domain>
Nov 09 02:14:40 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:14:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance destroyed successfully.
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:14:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] No VIF found with MAC fa:16:3e:7d:5e:ef, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-9299d6c2-7113-401b-9ed6-2e4e596f556e req-2225cb57-29ba-489a-8fb4-18c028217581 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9299d6c2-7113-401b-9ed6-2e4e596f556e req-2225cb57-29ba-489a-8fb4-18c028217581 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9299d6c2-7113-401b-9ed6-2e4e596f556e req-2225cb57-29ba-489a-8fb4-18c028217581 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9299d6c2-7113-401b-9ed6-2e4e596f556e req-2225cb57-29ba-489a-8fb4-18c028217581 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-9299d6c2-7113-401b-9ed6-2e4e596f556e req-2225cb57-29ba-489a-8fb4-18c028217581 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:41 user nova-compute[75438]: WARNING nova.compute.manager [req-9299d6c2-7113-401b-9ed6-2e4e596f556e req-2225cb57-29ba-489a-8fb4-18c028217581 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state building and task_state spawning.
Nov 09 02:14:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-e13a9d03-2ecf-43bf-8093-f505b5d5f16a req-0da37021-06fe-437e-a1b3-c4ee5a50ea45 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e13a9d03-2ecf-43bf-8093-f505b5d5f16a req-0da37021-06fe-437e-a1b3-c4ee5a50ea45 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e13a9d03-2ecf-43bf-8093-f505b5d5f16a req-0da37021-06fe-437e-a1b3-c4ee5a50ea45 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e13a9d03-2ecf-43bf-8093-f505b5d5f16a req-0da37021-06fe-437e-a1b3-c4ee5a50ea45 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-e13a9d03-2ecf-43bf-8093-f505b5d5f16a req-0da37021-06fe-437e-a1b3-c4ee5a50ea45 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:43 user nova-compute[75438]: WARNING nova.compute.manager [req-e13a9d03-2ecf-43bf-8093-f505b5d5f16a req-0da37021-06fe-437e-a1b3-c4ee5a50ea45 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state building and task_state spawning.
Nov 09 02:14:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:14:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance spawned successfully.
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:45 user nova-compute[75438]: WARNING nova.compute.manager [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state active and task_state rescuing.
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:14:45 user nova-compute[75438]: WARNING nova.compute.manager [req-35db560e-b81d-4f87-876a-8a643fa36e72 req-163ea553-b3c2-4142-b0a1-99b3bc487a5d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state active and task_state rescuing.
Nov 09 02:14:45 user nova-compute[75438]: INFO nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Took 9.01 seconds to spawn the instance on the hypervisor.
Nov 09 02:14:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:14:45 user nova-compute[75438]: INFO nova.compute.manager [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Took 51.30 seconds to build instance.
Nov 09 02:14:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-959ee5a8-3d54-4567-9b7c-7e732e3749b4 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "074d5809-da5f-4158-83e1-651c8518efaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.415s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:14:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6e16f566-22e6-4bc1-9289-2f8e9d329281 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:14:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:14:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing instance network info cache due to event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:14 user nova-compute[75438]: DEBUG nova.network.neutron [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updated VIF entry in instance network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b337c34-b68d-4c28-afc3-7941b377c342 req-f361bb8c-5667-4821-8cdd-04ede040288d service nova] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:15 user nova-compute[75438]: INFO nova.compute.manager [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Shelve offloading
Nov 09 02:15:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-22a3b637-c45b-4938-a42b-22dccdc166d4 req-ddeaca26-edf2-48fa-a557-75e4d7df8672 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-unplugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-22a3b637-c45b-4938-a42b-22dccdc166d4 req-ddeaca26-edf2-48fa-a557-75e4d7df8672 service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-22a3b637-c45b-4938-a42b-22dccdc166d4 req-ddeaca26-edf2-48fa-a557-75e4d7df8672 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-22a3b637-c45b-4938-a42b-22dccdc166d4 req-ddeaca26-edf2-48fa-a557-75e4d7df8672 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-22a3b637-c45b-4938-a42b-22dccdc166d4 req-ddeaca26-edf2-48fa-a557-75e4d7df8672 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-unplugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:15 user nova-compute[75438]: WARNING nova.compute.manager [req-22a3b637-c45b-4938-a42b-22dccdc166d4 req-ddeaca26-edf2-48fa-a557-75e4d7df8672 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-unplugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state active and task_state shelving.
Nov 09 02:15:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance destroyed successfully.
Nov 09 02:15:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:15:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:15:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:17 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance destroyed successfully.
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.objects.instance [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'resources' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-808013591',display_name='tempest-TestShelveInstance-server-808013591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-808013591',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlSBy/yEAN4Bi6etvD69gybdSwpkK9G4pYaYUcbe28q3nopNHbXNhwzJ7FXx7caugmEOAgerY48VBohwKxF85Y10hH+MaDCPyz1ofFYxWEZsPEDz/fGE40rgHQ6MMX8Cw==',key_name='tempest-TestShelveInstance-1475462915',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:13:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c37c1382f74f9689baf00837b8bfa8',ramdisk_id='',reservation_id='r-iysa0vvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-838005507',owner_user_name='tempest-TestShelveInstance-838005507-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:13:53Z,user_data=None,user_id='2959b8b821e9406480159ced072408e6',uuid=896758d5-8945-4fb7-a90f-a86084c7fd3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converting VIF {"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_vif [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dcd4f57-48, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d778f597-d617-40da-814d-272558a4697b) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing instance network info cache due to event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.network.neutron [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:17 user nova-compute[75438]: INFO os_vif [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48')
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:17 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c05c29-ea24-4d8c-bb82-89dafd19b791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:15:17 user nova-compute[75438]: No targets found.
Nov 09 02:15:17 user nova-compute[75438]: iSNS:
Nov 09 02:15:17 user nova-compute[75438]: No targets found.
Nov 09 02:15:17 user nova-compute[75438]: STATIC:
Nov 09 02:15:17 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:15:17 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:17 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:17 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:15:17 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:17 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:17 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:15:17 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:17 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:17 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:15:17 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:17 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:17 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128
Nov 09 02:15:17 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:17 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:17 user nova-compute[75438]: FIRMWARE:
Nov 09 02:15:17 user nova-compute[75438]: No targets found.
Nov 09 02:15:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:15:17 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:15:17 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9961fb5-6cb1-40b3-9589-716a4226b580]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5621b0f1-a80e-4f79-acf0-8068fabf071c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:17 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba2420f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[321dc2d9-3937-4e1e-92bb-b1b7603f4b82]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dd2c83-631e-44f5-90b4-2c0ead131bbe]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba634651-4845-46c2-9471-73e7cc3dc56b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7eb6fd-559b-4aac-b31c-6f491e58278e]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[691bd96e-cca5-40fc-a94f-8e0212d14f8c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2853cf-af9d-479f-950a-3216a3ea7c75]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]
Nov 09 02:15:17 user nova-compute[75438]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.
Nov 09 02:15:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d66e4-ffa7-4429-b5e5-baedf2b692f2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] <== disconnect_volume: return (342ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:15:17 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Deleting instance files /opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a_del
Nov 09 02:15:17 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Deletion of /opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a_del complete
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-faf9f4d0-21bd-4e64-835e-9bee148e6b8c req-ca8af513-966d-49c4-bb72-8d893ee9b6c5 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-faf9f4d0-21bd-4e64-835e-9bee148e6b8c req-ca8af513-966d-49c4-bb72-8d893ee9b6c5 service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-faf9f4d0-21bd-4e64-835e-9bee148e6b8c req-ca8af513-966d-49c4-bb72-8d893ee9b6c5 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-faf9f4d0-21bd-4e64-835e-9bee148e6b8c req-ca8af513-966d-49c4-bb72-8d893ee9b6c5 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-faf9f4d0-21bd-4e64-835e-9bee148e6b8c req-ca8af513-966d-49c4-bb72-8d893ee9b6c5 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:17 user nova-compute[75438]: WARNING nova.compute.manager [req-faf9f4d0-21bd-4e64-835e-9bee148e6b8c req-ca8af513-966d-49c4-bb72-8d893ee9b6c5 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state active and task_state shelving.
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.network.neutron [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updated VIF entry in instance network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG nova.network.neutron [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": null, "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f7b97418-6873-4873-ada2-d05eac197070 req-030e8d89-57c2-4337-82a7-d456be7665ed service nova] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:15:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:19 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:15:19 user nova-compute[75438]: INFO nova.compute.claims [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Claim successful on node user
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:15:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.policy [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a26a0160e8042e3a6a83bdb28a41ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be67d22752084a76b41a4e1cff3747cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:15:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Creating image(s)
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "/opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "/opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk 1073741824" returned: 0 in 0.055s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Successfully created port: 4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Cannot resize image /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Ensure instance console log exists: /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Successfully updated port: 4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquired lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-changed-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Refreshing instance network info cache due to event network-changed-4228b3fa-1303-4e30-85d4-dcba154f828b. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] Acquiring lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating instance_info_cache with network_info: [{"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Releasing lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Instance network_info: |[{"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] Acquired lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Refreshing network info cache for port 4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Start _get_guest_xml network_info=[{"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:15:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:15:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1193686961',display_name='tempest-AttachVolumeTestJSON-server-1193686961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1193686961',id=26,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdy3VWEfAlfb+M1a7ZgKzfyEXiFwFHTBpfw6+F2QlCUAKyd+5Fz8AWN2IhYHRB9G9izS7JxCEh23YB6gHXC0b+IhlTHehYd2zix6+v7PYip1wKbI67hm470lq6wBfW0XA==',key_name='tempest-keypair-656286225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-x9dphhfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=3ce04a63-a5b1-4945-82f9-ebd03614f722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:15:22 user nova-compute[75438]:   <uuid>3ce04a63-a5b1-4945-82f9-ebd03614f722</uuid>
Nov 09 02:15:22 user nova-compute[75438]:   <name>instance-0000001a</name>
Nov 09 02:15:22 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:15:22 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:15:22 user nova-compute[75438]:   <metadata>
Nov 09 02:15:22 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:15:22 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:15:22 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeTestJSON-server-1193686961</nova:name>
Nov 09 02:15:22 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:15:22</nova:creationTime>
Nov 09 02:15:22 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:15:22 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:15:22 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:15:22 user nova-compute[75438]:       <nova:owner>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:user uuid="6a26a0160e8042e3a6a83bdb28a41ad0">tempest-AttachVolumeTestJSON-74588244-project-member</nova:user>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:project uuid="be67d22752084a76b41a4e1cff3747cf">tempest-AttachVolumeTestJSON-74588244</nova:project>
Nov 09 02:15:22 user nova-compute[75438]:       </nova:owner>
Nov 09 02:15:22 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:15:22 user nova-compute[75438]:       <nova:ports>
Nov 09 02:15:22 user nova-compute[75438]:         <nova:port uuid="4228b3fa-1303-4e30-85d4-dcba154f828b">
Nov 09 02:15:22 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 02:15:22 user nova-compute[75438]:         </nova:port>
Nov 09 02:15:22 user nova-compute[75438]:       </nova:ports>
Nov 09 02:15:22 user nova-compute[75438]:     </nova:instance>
Nov 09 02:15:22 user nova-compute[75438]:   </metadata>
Nov 09 02:15:22 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:15:22 user nova-compute[75438]:     <system>
Nov 09 02:15:22 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:15:22 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:15:22 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:15:22 user nova-compute[75438]:       <entry name="serial">3ce04a63-a5b1-4945-82f9-ebd03614f722</entry>
Nov 09 02:15:22 user nova-compute[75438]:       <entry name="uuid">3ce04a63-a5b1-4945-82f9-ebd03614f722</entry>
Nov 09 02:15:22 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:15:22 user nova-compute[75438]:     </system>
Nov 09 02:15:22 user nova-compute[75438]:   </sysinfo>
Nov 09 02:15:22 user nova-compute[75438]:   <os>
Nov 09 02:15:22 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:15:22 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:15:22 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:15:22 user nova-compute[75438]:   </os>
Nov 09 02:15:22 user nova-compute[75438]:   <features>
Nov 09 02:15:22 user nova-compute[75438]:     <acpi/>
Nov 09 02:15:22 user nova-compute[75438]:     <apic/>
Nov 09 02:15:22 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:15:22 user nova-compute[75438]:   </features>
Nov 09 02:15:22 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:15:22 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:15:22 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:15:22 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:15:22 user nova-compute[75438]:   </clock>
Nov 09 02:15:22 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:15:22 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:15:22 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:15:22 user nova-compute[75438]:   </cpu>
Nov 09 02:15:22 user nova-compute[75438]:   <devices>
Nov 09 02:15:22 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:15:22 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:15:22 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk"/>
Nov 09 02:15:22 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:15:22 user nova-compute[75438]:     </disk>
Nov 09 02:15:22 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:15:22 user nova-compute[75438]:       <mac address="fa:16:3e:8d:78:22"/>
Nov 09 02:15:22 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:15:22 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:15:22 user nova-compute[75438]:       <target dev="tap4228b3fa-13"/>
Nov 09 02:15:22 user nova-compute[75438]:     </interface>
Nov 09 02:15:22 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:15:22 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/console.log" append="off"/>
Nov 09 02:15:22 user nova-compute[75438]:     </serial>
Nov 09 02:15:22 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:15:22 user nova-compute[75438]:     <video>
Nov 09 02:15:22 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:15:22 user nova-compute[75438]:     </video>
Nov 09 02:15:22 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:15:22 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:15:22 user nova-compute[75438]:     </rng>
Nov 09 02:15:22 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:15:22 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:15:22 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:15:22 user nova-compute[75438]:     </memballoon>
Nov 09 02:15:22 user nova-compute[75438]:   </devices>
Nov 09 02:15:22 user nova-compute[75438]: </domain>
Nov 09 02:15:22 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1193686961',display_name='tempest-AttachVolumeTestJSON-server-1193686961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1193686961',id=26,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdy3VWEfAlfb+M1a7ZgKzfyEXiFwFHTBpfw6+F2QlCUAKyd+5Fz8AWN2IhYHRB9G9izS7JxCEh23YB6gHXC0b+IhlTHehYd2zix6+v7PYip1wKbI67hm470lq6wBfW0XA==',key_name='tempest-keypair-656286225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-x9dphhfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:15:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=3ce04a63-a5b1-4945-82f9-ebd03614f722,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG os_vif [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '586d3723-3d57-5d9b-a9d6-6e5dfe517411', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4228b3fa-13, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4228b3fa-13, col_values=(('qos', UUID('f5eca810-baf1-47f6-835b-0bd366f3c75d')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4228b3fa-13, col_values=(('external_ids', {'iface-id': '4228b3fa-1303-4e30-85d4-dcba154f828b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:78:22', 'vm-uuid': '3ce04a63-a5b1-4945-82f9-ebd03614f722'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:22 user nova-compute[75438]: INFO os_vif [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13')
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No VIF found with MAC fa:16:3e:8d:78:22, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updated VIF entry in instance network info cache for port 4228b3fa-1303-4e30-85d4-dcba154f828b. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating instance_info_cache with network_info: [{"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b3f6125-02ab-43b6-9957-dde18867e67a req-7b6488da-6e45-48a6-aeb9-5683556ff149 service nova] Releasing lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:23 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Deleted allocations for instance 896758d5-8945-4fb7-a90f-a86084c7fd3a
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'numa_topology' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG nova.objects.base [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Object Instance<896758d5-8945-4fb7-a90f-a86084c7fd3a> lazy-loaded attributes: resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:23 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:15:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:23 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:15:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:23 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[123f737f-34f8-4d9a-b1a7-0473a1cc34ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:15:23 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c674bf-204b-4a7b-8b5e-10be0c3e93ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a] added
Nov 09 02:15:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78917fc6-9fcb-44e9-a45f-af98eed04d23 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.614s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c3fe8-bb7f-407b-a159-e65a878afe99]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b49ef5-a785-4394-8c1e-1f64881836d4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMHgCcRt {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMHgCcRt" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7993e0-9a08-48cc-9828-84aacc92dc19]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JMHgCcRt'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c116d77f-048f-4c7d-ac73-dbaa08c5af6e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-0bef64d9-8b03-420b-8557-dd3db48e60ca req-b9300204-e348-4cfa-bfe0-c70c1b78ab25 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0bef64d9-8b03-420b-8557-dd3db48e60ca req-b9300204-e348-4cfa-bfe0-c70c1b78ab25 service nova] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0bef64d9-8b03-420b-8557-dd3db48e60ca req-b9300204-e348-4cfa-bfe0-c70c1b78ab25 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0bef64d9-8b03-420b-8557-dd3db48e60ca req-b9300204-e348-4cfa-bfe0-c70c1b78ab25 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-0bef64d9-8b03-420b-8557-dd3db48e60ca req-b9300204-e348-4cfa-bfe0-c70c1b78ab25 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] No waiting events found dispatching network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:24 user nova-compute[75438]: WARNING nova.compute.manager [req-0bef64d9-8b03-420b-8557-dd3db48e60ca req-b9300204-e348-4cfa-bfe0-c70c1b78ab25 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received unexpected event network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b for instance with vm_state building and task_state spawning.
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b76fdb-47a5-4027-a0d3-11cde6bcb4ed]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c040da0-16dc-40e8-9a93-1d6262a36990]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]
Nov 09 02:15:24 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.
Nov 09 02:15:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ebd7a8-0927-4f98-bcdb-82bb5f9635a7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb2933-32c3-409a-b654-e36aa1335454]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:15:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:24 user nova-compute[75438]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:15:24 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[123bdf76-d130-4080-ab43-2ab9180a6c86]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26361663237616436', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361663237616436', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'flavor' on Instance uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:15:25 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:15:25 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:15:25 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:15:25 user nova-compute[75438]:   <serial>bc1e01dc-86c0-473d-a4a5-d1509479d43a</serial>
Nov 09 02:15:25 user nova-compute[75438]: </disk>
Nov 09 02:15:25 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:15:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No VIF found with MAC fa:16:3e:b0:5e:44, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-864dee74-4e4c-43e8-8950-26fb00c838b6 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 52.910s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:15:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Instance spawned successfully.
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-1b8c08a5-44b8-4352-b0a9-c640e8b8aa18 req-4d2dc0fe-93f2-4caa-a36a-9fcce9e91dc5 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1b8c08a5-44b8-4352-b0a9-c640e8b8aa18 req-4d2dc0fe-93f2-4caa-a36a-9fcce9e91dc5 service nova] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1b8c08a5-44b8-4352-b0a9-c640e8b8aa18 req-4d2dc0fe-93f2-4caa-a36a-9fcce9e91dc5 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1b8c08a5-44b8-4352-b0a9-c640e8b8aa18 req-4d2dc0fe-93f2-4caa-a36a-9fcce9e91dc5 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-1b8c08a5-44b8-4352-b0a9-c640e8b8aa18 req-4d2dc0fe-93f2-4caa-a36a-9fcce9e91dc5 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] No waiting events found dispatching network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:26 user nova-compute[75438]: WARNING nova.compute.manager [req-1b8c08a5-44b8-4352-b0a9-c640e8b8aa18 req-4d2dc0fe-93f2-4caa-a36a-9fcce9e91dc5 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received unexpected event network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b for instance with vm_state building and task_state spawning.
Nov 09 02:15:26 user nova-compute[75438]: INFO nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:15:26 user nova-compute[75438]: INFO nova.compute.manager [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Took 6.70 seconds to build instance.
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e2d62da0-5b7c-4d2b-8d5e-52f3ae46fe24 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:27 user nova-compute[75438]: INFO nova.compute.manager [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Rebuilding instance
Nov 09 02:15:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:15:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-eedc3d4b-4894-4a68-b01d-b1d23a101133 req-91cb12a0-0f5d-46c1-88ee-3c37c27c2d00 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-unplugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eedc3d4b-4894-4a68-b01d-b1d23a101133 req-91cb12a0-0f5d-46c1-88ee-3c37c27c2d00 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eedc3d4b-4894-4a68-b01d-b1d23a101133 req-91cb12a0-0f5d-46c1-88ee-3c37c27c2d00 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eedc3d4b-4894-4a68-b01d-b1d23a101133 req-91cb12a0-0f5d-46c1-88ee-3c37c27c2d00 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-eedc3d4b-4894-4a68-b01d-b1d23a101133 req-91cb12a0-0f5d-46c1-88ee-3c37c27c2d00 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-unplugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:28 user nova-compute[75438]: WARNING nova.compute.manager [req-eedc3d4b-4894-4a68-b01d-b1d23a101133 req-91cb12a0-0f5d-46c1-88ee-3c37c27c2d00 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-unplugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state active and task_state rebuilding.
Nov 09 02:15:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance destroyed successfully.
Nov 09 02:15:28 user nova-compute[75438]: INFO nova.compute.manager [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Detaching volume bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:15:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:28 user nova-compute[75438]: INFO nova.virt.block_device [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attempting to driver detach volume bc1e01dc-86c0-473d-a4a5-d1509479d43a from mountpoint /dev/vdb
Nov 09 02:15:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Attempting to detach device vdb from instance a3b47518-63f5-4a38-834d-5627bec3892d from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:15:28 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:15:28 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:15:28 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:15:28 user nova-compute[75438]:   <serial>bc1e01dc-86c0-473d-a4a5-d1509479d43a</serial>
Nov 09 02:15:28 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:15:28 user nova-compute[75438]: </disk>
Nov 09 02:15:28 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:15:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully detached device vdb from instance a3b47518-63f5-4a38-834d-5627bec3892d from the persistent domain config.
Nov 09 02:15:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:28 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:15:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[19110722-eb52-4295-a5b0-f80f6a7be38a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:15:28 user nova-compute[75438]: No targets found.
Nov 09 02:15:28 user nova-compute[75438]: iSNS:
Nov 09 02:15:28 user nova-compute[75438]: No targets found.
Nov 09 02:15:28 user nova-compute[75438]: STATIC:
Nov 09 02:15:28 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:15:28 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:28 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:28 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:15:28 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:28 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:28 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:15:28 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:28 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:28 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:15:28 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:28 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:28 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:15:28 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:28 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:28 user nova-compute[75438]: FIRMWARE:
Nov 09 02:15:28 user nova-compute[75438]: No targets found.
Nov 09 02:15:28 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:15:28 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:15:28 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d46b408-7a37-405c-a7ad-2ba4eeffec9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69c4e5-3144-4910-984c-9a8474acf0b7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:15:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:29 user nova-compute[75438]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:15:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba2459b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e5deb-f94b-4036-aa40-79c5db785c63]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e01502-6eb8-4287-9f51-fd625267f01d]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bbd374-2590-4f23-a4ce-038dbb43ba7f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f490d473-0b52-4ad7-84a5-4c51cbafe1ce]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7757d8eb-76ce-4f7e-9b13-843f51ff647f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd916c5f-03ac-452c-99ea-3ed99715af78]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]
Nov 09 02:15:29 user nova-compute[75438]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.
Nov 09 02:15:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac67ecea-c841-4188-b579-72896bb923bc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== disconnect_volume: return (395ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-bc80d937-b4a3-4bd7-8c4b-57330ad80dfc req-ca6e0049-923d-483a-a967-b88f8d027e63 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc80d937-b4a3-4bd7-8c4b-57330ad80dfc req-ca6e0049-923d-483a-a967-b88f8d027e63 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc80d937-b4a3-4bd7-8c4b-57330ad80dfc req-ca6e0049-923d-483a-a967-b88f8d027e63 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bc80d937-b4a3-4bd7-8c4b-57330ad80dfc req-ca6e0049-923d-483a-a967-b88f8d027e63 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-bc80d937-b4a3-4bd7-8c4b-57330ad80dfc req-ca6e0049-923d-483a-a967-b88f8d027e63 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:30 user nova-compute[75438]: WARNING nova.compute.manager [req-bc80d937-b4a3-4bd7-8c4b-57330ad80dfc req-ca6e0049-923d-483a-a967-b88f8d027e63 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state active and task_state rebuilding.
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance destroyed successfully.
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1069873586',display_name='tempest-ServerActionsTestOtherA-server-1259510329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1069873586',id=20,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY0jLkcGufpfBdu/y9o49RBsRGgTXVSjBjf2C7iYfthjQWpmZCBzLxp9Vt68/r4MB2JcjuWyuMtgyxlmcrRIR84pgpDcpS6QpDg62POpG8vOnhxC2w0TRYFSJLpyoKA6w==',key_name='tempest-keypair-355792053',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-xxvqv43c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:15:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=a3b47518-63f5-4a38-834d-5627bec3892d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40acfb20-c0, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24b399ba-525a-41ac-81bd-cb1ac16dcc32) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:15:30 user nova-compute[75438]: INFO os_vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0')
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:30 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[376078fd-4a14-46f3-96b9-f564182934a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:15:30 user nova-compute[75438]: No targets found.
Nov 09 02:15:30 user nova-compute[75438]: iSNS:
Nov 09 02:15:30 user nova-compute[75438]: No targets found.
Nov 09 02:15:30 user nova-compute[75438]: STATIC:
Nov 09 02:15:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:15:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:15:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:15:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:30 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:15:30 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:30 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:30 user nova-compute[75438]: FIRMWARE:
Nov 09 02:15:30 user nova-compute[75438]: No targets found.
Nov 09 02:15:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:15:30 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:15:30 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b893ed9c-2f13-4f13-a005-0ca96797df64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c2c2d2-7fd3-421e-8522-9bef4a80ba4c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:30 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:30 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:30 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:30 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:30 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:30 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba242d9c60>, {}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Disconnecting from: [] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.131s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== disconnect_volume: return (134ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:15:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Deleting instance files /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d_del
Nov 09 02:15:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Deletion of /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d_del complete
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:30 user nova-compute[75438]: INFO nova.virt.block_device [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Booting with volume bc1e01dc-86c0-473d-a4a5-d1509479d43a at /dev/vdb
Nov 09 02:15:31 user nova-compute[75438]: DEBUG os_brick.utils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cfa791-d6ca-450f-ac37-fa40a35b6bc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe67086-4ead-4605-9816-df557d8d1412]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eb3e21-fea2-4d6e-908e-06227b1a2b24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e204dd-fad0-4476-8da7-a7026061ad45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:15:31 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cf835e-309d-40f4-908a-7b619838f617]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG os_brick.utils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updating existing volume attachment record: 19b8ede9-588f-4202-89a4-cf025e3f41b7 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Error from libvirt while getting description of instance-00000014: [Error Code 42] Domain not found: no domain with matching uuid 'a3b47518-63f5-4a38-834d-5627bec3892d' (instance-00000014): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a3b47518-63f5-4a38-834d-5627bec3892d' (instance-00000014)
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:34 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:15:34 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7075MB free_disk=24.931873321533203GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a3b47518-63f5-4a38-834d-5627bec3892d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 256ada78-3695-4784-953b-c57f555a1ee6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:15:34 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:15:35 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:15:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:15:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:15:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-changed-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Refreshing instance network info cache due to event network-changed-2b7ebd43-e9ca-4321-8276-0a43621c89a1. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] Acquiring lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] Acquired lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG nova.network.neutron [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Refreshing network info cache for port 2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG nova.network.neutron [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updated VIF entry in instance network info cache for port 2b7ebd43-e9ca-4321-8276-0a43621c89a1. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:15:45 user nova-compute[75438]: DEBUG nova.network.neutron [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating instance_info_cache with network_info: [{"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2c54b4c6-d081-48d3-94fd-86b9f1f08c5b req-ed345220-b057-4707-84a5-97c44b8852ab service nova] Releasing lock "refresh_cache-84a69147-dc3e-4bd3-83e0-4656d2d8ea16" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:46 user nova-compute[75438]: INFO nova.compute.manager [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Unrescuing
Nov 09 02:15:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:15:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:15:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:15:46 user nova-compute[75438]: INFO nova.compute.manager [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Rebuilding instance
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'flavor' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-f606328f-a493-4067-9a9d-dc5d2c26e7d3 req-c8e628bb-642b-49f6-980a-e7566932dd92 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-unplugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f606328f-a493-4067-9a9d-dc5d2c26e7d3 req-c8e628bb-642b-49f6-980a-e7566932dd92 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f606328f-a493-4067-9a9d-dc5d2c26e7d3 req-c8e628bb-642b-49f6-980a-e7566932dd92 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f606328f-a493-4067-9a9d-dc5d2c26e7d3 req-c8e628bb-642b-49f6-980a-e7566932dd92 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-f606328f-a493-4067-9a9d-dc5d2c26e7d3 req-c8e628bb-642b-49f6-980a-e7566932dd92 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-unplugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:47 user nova-compute[75438]: WARNING nova.compute.manager [req-f606328f-a493-4067-9a9d-dc5d2c26e7d3 req-c8e628bb-642b-49f6-980a-e7566932dd92 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-unplugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state active and task_state rebuilding.
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-87f66e89-1b18-47bd-8719-c72c2f7273d6 req-e3040dd9-ec4e-470d-a854-2aa6fe8eb27a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-87f66e89-1b18-47bd-8719-c72c2f7273d6 req-e3040dd9-ec4e-470d-a854-2aa6fe8eb27a service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-87f66e89-1b18-47bd-8719-c72c2f7273d6 req-e3040dd9-ec4e-470d-a854-2aa6fe8eb27a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-87f66e89-1b18-47bd-8719-c72c2f7273d6 req-e3040dd9-ec4e-470d-a854-2aa6fe8eb27a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-87f66e89-1b18-47bd-8719-c72c2f7273d6 req-e3040dd9-ec4e-470d-a854-2aa6fe8eb27a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:47 user nova-compute[75438]: WARNING nova.compute.manager [req-87f66e89-1b18-47bd-8719-c72c2f7273d6 req-e3040dd9-ec4e-470d-a854-2aa6fe8eb27a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance destroyed successfully.
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance destroyed successfully.
Nov 09 02:15:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1844743210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-594334493',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5tur4KHsYWmYr5apfE+nTJUUV0P9vgLOi9qtfxKdVRfN7Z/ln6xZmAnG5/s4YQ5a62+x2A+XbtT/mc9SdFYtWXrp+O6WCdeNIwExdi3ksz4Re8DoIPfr3LiQfM71S8A==',key_name='tempest-keypair-959261134',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b90a39ccf04453387605602fd424452',ramdisk_id='',reservation_id='r-f42cnvuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1084561406',owner_user_name='tempest-ServerActionsV293TestJSON-1084561406-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d42bf053761842be974389361ec9f89e',uuid=84a69147-dc3e-4bd3-83e0-4656d2d8ea16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converting VIF {"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b7ebd43-e9, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance destroyed successfully.
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68a08118-f703-4038-98be-96b9e9c042c4) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: INFO os_vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9')
Nov 09 02:15:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b5862b-9ad0-4a9d-b645-4e85036ab944]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:15:48 user nova-compute[75438]: No targets found.
Nov 09 02:15:48 user nova-compute[75438]: iSNS:
Nov 09 02:15:48 user nova-compute[75438]: No targets found.
Nov 09 02:15:48 user nova-compute[75438]: STATIC:
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: FIRMWARE:
Nov 09 02:15:48 user nova-compute[75438]: No targets found.
Nov 09 02:15:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:15:48 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:15:48 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1058736-e430-47be-88ff-8be4d6caf328]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1065560c-e4b6-4ab7-bedc-5b2f84ab586e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:48 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:48 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:48 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:48 user nova-compute[75438]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:15:48 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:48 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba242da0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5479dd47-e92e-4d82-92f2-35c92ee37b87]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[14554085-3134-4a82-8655-6c10d8c168cb]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c062f-eca1-462f-ad05-a17dd9da3b27]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cb6ac4-6412-4904-bf30-e6e8c2e6c18d]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fe0e6a-3bce-488d-b79a-8ad9f730289b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3edd4-9136-41d1-b668-d0fd63fb37ed]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]
Nov 09 02:15:48 user nova-compute[75438]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.
Nov 09 02:15:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea81fb4-595c-47a5-964e-c7ddd0524928]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== disconnect_volume: return (363ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:15:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Deleting instance files /opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16_del
Nov 09 02:15:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Deletion of /opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16_del complete
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:48 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 could not be found.
Nov 09 02:15:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1baa35-542c-4d01-b603-b0f295e37ccd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:15:48 user nova-compute[75438]: No targets found.
Nov 09 02:15:48 user nova-compute[75438]: iSNS:
Nov 09 02:15:48 user nova-compute[75438]: No targets found.
Nov 09 02:15:48 user nova-compute[75438]: STATIC:
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:15:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:15:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:15:48 user nova-compute[75438]: FIRMWARE:
Nov 09 02:15:48 user nova-compute[75438]: No targets found.
Nov 09 02:15:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:15:48 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:15:48 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:15:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[30abf6d2-f0cb-4e27-9d11-8ec44bcdc562]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5be64be-28f6-4bce-ab94-37db50f54a4a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:49 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:49 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:49 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:49 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0455f490>, {}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Disconnecting from: [] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== disconnect_volume: return (78ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-c1becf7b-b78d-4182-b5cd-f17dac06e119 req-ff5e696b-3788-4405-950f-faedcc271642 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c1becf7b-b78d-4182-b5cd-f17dac06e119 req-ff5e696b-3788-4405-950f-faedcc271642 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c1becf7b-b78d-4182-b5cd-f17dac06e119 req-ff5e696b-3788-4405-950f-faedcc271642 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c1becf7b-b78d-4182-b5cd-f17dac06e119 req-ff5e696b-3788-4405-950f-faedcc271642 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-c1becf7b-b78d-4182-b5cd-f17dac06e119 req-ff5e696b-3788-4405-950f-faedcc271642 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:49 user nova-compute[75438]: WARNING nova.compute.manager [req-c1becf7b-b78d-4182-b5cd-f17dac06e119 req-ff5e696b-3788-4405-950f-faedcc271642 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state active and task_state rebuilding.
Nov 09 02:15:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-7efe708d-90c8-416a-a627-20779d9df91e req-a1aeecfd-fab3-4f92-8416-2bfcbe960d36 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7efe708d-90c8-416a-a627-20779d9df91e req-a1aeecfd-fab3-4f92-8416-2bfcbe960d36 service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7efe708d-90c8-416a-a627-20779d9df91e req-a1aeecfd-fab3-4f92-8416-2bfcbe960d36 service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7efe708d-90c8-416a-a627-20779d9df91e req-a1aeecfd-fab3-4f92-8416-2bfcbe960d36 service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-7efe708d-90c8-416a-a627-20779d9df91e req-a1aeecfd-fab3-4f92-8416-2bfcbe960d36 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:49 user nova-compute[75438]: WARNING nova.compute.manager [req-7efe708d-90c8-416a-a627-20779d9df91e req-a1aeecfd-fab3-4f92-8416-2bfcbe960d36 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:15:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Preparing to wait for external event volume-reimaged-dcde84f2-18d7-4352-bdcd-969ba7a227ba {{(pid=75438) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 09 02:15:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:51 user nova-compute[75438]: WARNING nova.compute.manager [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:15:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:15:51 user nova-compute[75438]: WARNING nova.compute.manager [req-72e2a773-a689-4ea7-9529-47b64e4a4b72 req-1ad4d65a-5baf-4221-8300-5ed08d13069a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:15:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f926eba5-b36f-4bce-aa3e-501479d7b404 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:15:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:15:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Creating image(s)
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk 1073741824" returned: 0 in 0.059s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Cannot resize image /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Ensure instance console log exists: /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Start _get_guest_xml network_info=[{"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '19b8ede9-588f-4202-89a4-cf025e3f41b7', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3b47518-63f5-4a38-834d-5627bec3892d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'serial': 'bc1e01dc-86c0-473d-a4a5-d1509479d43a'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:15:58 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 02:15:58 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.objects.instance [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:15:58 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:58 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:15:58 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a69548f-7f5c-4ab3-bc9d-2cac598ff367]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:15:58 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc6234e-70b4-43b0-a5ca-9a70e37300d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a] added
Nov 09 02:15:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52588a2-8d82-4289-92b7-f02446427069]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144cd83-b479-48ec-b11e-a0f0117ca56e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMHgCcRt {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JMHgCcRt" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c76d16-491e-4d69-a629-8ddf39a6e848]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JMHgCcRt'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.217s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea93d53d-7589-43f5-99d6-036b2c87bbd0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6905d596-66d6-4aa0-9215-da7e0a0f5bdb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:58 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:58 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:58 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:58 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d6917-bd90-406e-adb9-1adbd440a48f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]
Nov 09 02:15:59 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.
Nov 09 02:15:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[602509a4-3184-4016-a9a3-a7565c1fd68b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876af2e-d2fc-4a3f-812c-4884ffeaa154]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:59 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:59 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:59 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:15:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:15:59 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:15:59 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:15:59 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:15:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.542s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb39de8-18d8-4a37-965c-be05cfe6f9de]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:15:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.580s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== connect_volume: return (1582ms) {'type': 'block', 'scsi_wwn': '26361663237616436', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361663237616436', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1069873586',display_name='tempest-ServerActionsTestOtherA-server-1259510329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1069873586',id=20,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY0jLkcGufpfBdu/y9o49RBsRGgTXVSjBjf2C7iYfthjQWpmZCBzLxp9Vt68/r4MB2JcjuWyuMtgyxlmcrRIR84pgpDcpS6QpDg62POpG8vOnhxC2w0TRYFSJLpyoKA6w==',key_name='tempest-keypair-355792053',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-xxvqv43c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=a3b47518-63f5-4a38-834d-5627bec3892d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:16:00 user nova-compute[75438]:   <uuid>a3b47518-63f5-4a38-834d-5627bec3892d</uuid>
Nov 09 02:16:00 user nova-compute[75438]:   <name>instance-00000014</name>
Nov 09 02:16:00 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:16:00 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:16:00 user nova-compute[75438]:   <metadata>
Nov 09 02:16:00 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:16:00 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:16:00 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherA-server-1259510329</nova:name>
Nov 09 02:16:00 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:15:58</nova:creationTime>
Nov 09 02:16:00 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:16:00 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:16:00 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:16:00 user nova-compute[75438]:       <nova:owner>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:user uuid="e95d2465b0af4dcab397b5ccc2809c59">tempest-ServerActionsTestOtherA-1813489270-project-member</nova:user>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:project uuid="7a4b29710bb14b8fb9714109aec43dc6">tempest-ServerActionsTestOtherA-1813489270</nova:project>
Nov 09 02:16:00 user nova-compute[75438]:       </nova:owner>
Nov 09 02:16:00 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:16:00 user nova-compute[75438]:       <nova:ports>
Nov 09 02:16:00 user nova-compute[75438]:         <nova:port uuid="40acfb20-c0f4-47b9-a8c5-87cec6f4f24f">
Nov 09 02:16:00 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:16:00 user nova-compute[75438]:         </nova:port>
Nov 09 02:16:00 user nova-compute[75438]:       </nova:ports>
Nov 09 02:16:00 user nova-compute[75438]:     </nova:instance>
Nov 09 02:16:00 user nova-compute[75438]:   </metadata>
Nov 09 02:16:00 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:16:00 user nova-compute[75438]:     <system>
Nov 09 02:16:00 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:16:00 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:16:00 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:16:00 user nova-compute[75438]:       <entry name="serial">a3b47518-63f5-4a38-834d-5627bec3892d</entry>
Nov 09 02:16:00 user nova-compute[75438]:       <entry name="uuid">a3b47518-63f5-4a38-834d-5627bec3892d</entry>
Nov 09 02:16:00 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:16:00 user nova-compute[75438]:     </system>
Nov 09 02:16:00 user nova-compute[75438]:   </sysinfo>
Nov 09 02:16:00 user nova-compute[75438]:   <os>
Nov 09 02:16:00 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:16:00 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:16:00 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:16:00 user nova-compute[75438]:   </os>
Nov 09 02:16:00 user nova-compute[75438]:   <features>
Nov 09 02:16:00 user nova-compute[75438]:     <acpi/>
Nov 09 02:16:00 user nova-compute[75438]:     <apic/>
Nov 09 02:16:00 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:16:00 user nova-compute[75438]:   </features>
Nov 09 02:16:00 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:16:00 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:16:00 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:16:00 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:16:00 user nova-compute[75438]:   </clock>
Nov 09 02:16:00 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:16:00 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:16:00 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:16:00 user nova-compute[75438]:   </cpu>
Nov 09 02:16:00 user nova-compute[75438]:   <devices>
Nov 09 02:16:00 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:16:00 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:16:00 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk"/>
Nov 09 02:16:00 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:16:00 user nova-compute[75438]:     </disk>
Nov 09 02:16:00 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:16:00 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:00 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:16:00 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:16:00 user nova-compute[75438]:       <serial>bc1e01dc-86c0-473d-a4a5-d1509479d43a</serial>
Nov 09 02:16:00 user nova-compute[75438]:     </disk>
Nov 09 02:16:00 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:16:00 user nova-compute[75438]:       <mac address="fa:16:3e:b0:5e:44"/>
Nov 09 02:16:00 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:16:00 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:16:00 user nova-compute[75438]:       <target dev="tap40acfb20-c0"/>
Nov 09 02:16:00 user nova-compute[75438]:     </interface>
Nov 09 02:16:00 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:16:00 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/console.log" append="off"/>
Nov 09 02:16:00 user nova-compute[75438]:     </serial>
Nov 09 02:16:00 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:16:00 user nova-compute[75438]:     <video>
Nov 09 02:16:00 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:16:00 user nova-compute[75438]:     </video>
Nov 09 02:16:00 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:16:00 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:16:00 user nova-compute[75438]:     </rng>
Nov 09 02:16:00 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:16:00 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:16:00 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:16:00 user nova-compute[75438]:     </memballoon>
Nov 09 02:16:00 user nova-compute[75438]:   </devices>
Nov 09 02:16:00 user nova-compute[75438]: </domain>
Nov 09 02:16:00 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1069873586',display_name='tempest-ServerActionsTestOtherA-server-1259510329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1069873586',id=20,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY0jLkcGufpfBdu/y9o49RBsRGgTXVSjBjf2C7iYfthjQWpmZCBzLxp9Vt68/r4MB2JcjuWyuMtgyxlmcrRIR84pgpDcpS6QpDg62POpG8vOnhxC2w0TRYFSJLpyoKA6w==',key_name='tempest-keypair-355792053',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:12:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-xxvqv43c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=a3b47518-63f5-4a38-834d-5627bec3892d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG os_vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '817d1e6d-9b64-59e9-8be0-5d14a894f111', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40acfb20-c0, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40acfb20-c0, col_values=(('qos', UUID('a900facd-5203-44a0-8769-6403cf33cd52')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40acfb20-c0, col_values=(('external_ids', {'iface-id': '40acfb20-c0f4-47b9-a8c5-87cec6f4f24f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5e:44', 'vm-uuid': 'a3b47518-63f5-4a38-834d-5627bec3892d'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:00 user nova-compute[75438]: INFO os_vif [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0')
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No VIF found with MAC fa:16:3e:b0:5e:44, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:16:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-15a091ab-7ba3-4351-aac2-228dc0c17892 req-43923396-3ba0-4c31-b6c4-ba4df65a6bf0 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-15a091ab-7ba3-4351-aac2-228dc0c17892 req-43923396-3ba0-4c31-b6c4-ba4df65a6bf0 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-15a091ab-7ba3-4351-aac2-228dc0c17892 req-43923396-3ba0-4c31-b6c4-ba4df65a6bf0 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-15a091ab-7ba3-4351-aac2-228dc0c17892 req-43923396-3ba0-4c31-b6c4-ba4df65a6bf0 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-15a091ab-7ba3-4351-aac2-228dc0c17892 req-43923396-3ba0-4c31-b6c4-ba4df65a6bf0 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:01 user nova-compute[75438]: WARNING nova.compute.manager [req-15a091ab-7ba3-4351-aac2-228dc0c17892 req-43923396-3ba0-4c31-b6c4-ba4df65a6bf0 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state active and task_state rebuild_spawning.
Nov 09 02:16:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-eaa299d0-365f-417c-b104-271d473faf8e req-4990ea94-b729-4d44-9e62-d0d4e53e3880 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eaa299d0-365f-417c-b104-271d473faf8e req-4990ea94-b729-4d44-9e62-d0d4e53e3880 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eaa299d0-365f-417c-b104-271d473faf8e req-4990ea94-b729-4d44-9e62-d0d4e53e3880 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eaa299d0-365f-417c-b104-271d473faf8e req-4990ea94-b729-4d44-9e62-d0d4e53e3880 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-eaa299d0-365f-417c-b104-271d473faf8e req-4990ea94-b729-4d44-9e62-d0d4e53e3880 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:04 user nova-compute[75438]: WARNING nova.compute.manager [req-eaa299d0-365f-417c-b104-271d473faf8e req-4990ea94-b729-4d44-9e62-d0d4e53e3880 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state active and task_state rebuild_spawning.
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:16:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance spawned successfully.
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG nova.objects.instance [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75438) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 09 02:16:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-118afaf8-682c-46c3-bdca-7f4cfffb18b2 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-changed-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Refreshing instance network info cache due to event network-changed-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] Acquiring lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] Acquired lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG nova.network.neutron [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Refreshing network info cache for port afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG nova.network.neutron [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updated VIF entry in instance network info cache for port afa7dc68-4325-4ee5-96f3-4b7a2dad9e07. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG nova.network.neutron [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating instance_info_cache with network_info: [{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1aa6cba9-db8b-44bb-920b-12d317d462ba req-fd3e4756-f65f-47a2-b86b-cd4fa6660f7f service nova] Releasing lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'flavor' on Instance uuid 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:19 user nova-compute[75438]: INFO nova.compute.manager [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Attaching volume 16f2856e-bc93-45b0-9cda-6e58273e516d to /dev/vdb
Nov 09 02:16:19 user nova-compute[75438]: DEBUG os_brick.utils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:16:19 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[87848283-356f-4287-a043-307d6e97d1e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[788875f3-64c5-4b6d-a144-ccbbd405f7f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2fea3e-ac3b-4ce3-90f5-982d08756d36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5986e952-882e-4e95-b720-099790a5034b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:16:20 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:16:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd460dc-715e-4d71-bfd7-04d825acadd7]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG os_brick.utils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating existing volume attachment record: 967e0a2b-9c30-4f0f-8fb2-bfcad08b2e14 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "256ada78-3695-4784-953b-c57f555a1ee6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:24 user nova-compute[75438]: INFO nova.compute.manager [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Terminating instance
Nov 09 02:16:24 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-40a75321-6b4d-4382-87d4-feee7c8d1e2c req-88bd1954-1a4c-42c6-b771-fad297742bc9 service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-vif-unplugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-40a75321-6b4d-4382-87d4-feee7c8d1e2c req-88bd1954-1a4c-42c6-b771-fad297742bc9 service nova] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-40a75321-6b4d-4382-87d4-feee7c8d1e2c req-88bd1954-1a4c-42c6-b771-fad297742bc9 service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-40a75321-6b4d-4382-87d4-feee7c8d1e2c req-88bd1954-1a4c-42c6-b771-fad297742bc9 service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-40a75321-6b4d-4382-87d4-feee7c8d1e2c req-88bd1954-1a4c-42c6-b771-fad297742bc9 service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] No waiting events found dispatching network-vif-unplugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-40a75321-6b4d-4382-87d4-feee7c8d1e2c req-88bd1954-1a4c-42c6-b771-fad297742bc9 service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-vif-unplugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Instance destroyed successfully.
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'resources' on Instance uuid 256ada78-3695-4784-953b-c57f555a1ee6 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1762093738',display_name='tempest-VolumesAdminNegativeTest-server-1762093738',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1762093738',id=22,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:13:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e2b5db9464d15aa10f4f889e9d320',ramdisk_id='',reservation_id='r-6n4ivk6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1041878911',owner_user_name='tempest-VolumesAdminNegativeTest-1041878911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:13:57Z,user_data=None,user_id='866048ee57714ee7aae7be2a57102b0a',uuid=256ada78-3695-4784-953b-c57f555a1ee6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converting VIF {"id": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "address": "fa:16:3e:33:c8:0f", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71008ce9-f7", "ovs_interfaceid": "71008ce9-f7e4-454d-bf36-308a4bf08b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG os_vif [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71008ce9-f7, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44e7b93c-cddc-4f46-a69c-ada74a754734) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:16:25 user nova-compute[75438]: INFO os_vif [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c8:0f,bridge_name='br-int',has_traffic_filtering=True,id=71008ce9-f7e4-454d-bf36-308a4bf08b2a,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71008ce9-f7')
Nov 09 02:16:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Deleting instance files /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6_del
Nov 09 02:16:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Deletion of /opt/stack/data/nova/instances/256ada78-3695-4784-953b-c57f555a1ee6_del complete
Nov 09 02:16:25 user nova-compute[75438]: INFO nova.compute.manager [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 09 02:16:25 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:16:25 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:16:26 user nova-compute[75438]: INFO nova.compute.manager [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Unrescuing
Nov 09 02:16:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:26 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Took 0.84 seconds to deallocate network for instance.
Nov 09 02:16:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'flavor' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] Acquiring lock "256ada78-3695-4784-953b-c57f555a1ee6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] Lock "256ada78-3695-4784-953b-c57f555a1ee6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] No waiting events found dispatching network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:27 user nova-compute[75438]: WARNING nova.compute.manager [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received unexpected event network-vif-plugged-71008ce9-f7e4-454d-bf36-308a4bf08b2a for instance with vm_state deleted and task_state None.
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-c9445d3d-d4b9-4e0c-bd19-fe021ca0985b req-2581c86b-9271-4f66-800a-645fc2a3149b service nova] [instance: 256ada78-3695-4784-953b-c57f555a1ee6] Received event network-vif-deleted-71008ce9-f7e4-454d-bf36-308a4bf08b2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.679s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:27 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Deleted allocations for instance 256ada78-3695-4784-953b-c57f555a1ee6
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-62e6521b-43bb-4df5-8268-5c62d36a331e req-c7b160f6-5919-4e46-ba24-f03c5fa70fc8 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-62e6521b-43bb-4df5-8268-5c62d36a331e req-c7b160f6-5919-4e46-ba24-f03c5fa70fc8 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-62e6521b-43bb-4df5-8268-5c62d36a331e req-c7b160f6-5919-4e46-ba24-f03c5fa70fc8 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-62e6521b-43bb-4df5-8268-5c62d36a331e req-c7b160f6-5919-4e46-ba24-f03c5fa70fc8 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-62e6521b-43bb-4df5-8268-5c62d36a331e req-c7b160f6-5919-4e46-ba24-f03c5fa70fc8 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:27 user nova-compute[75438]: WARNING nova.compute.manager [req-62e6521b-43bb-4df5-8268-5c62d36a331e req-c7b160f6-5919-4e46-ba24-f03c5fa70fc8 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1a72802b-9ccf-4182-970d-82248545402e tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "256ada78-3695-4784-953b-c57f555a1ee6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:27 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance destroyed successfully.
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:16:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updating instance_info_cache with network_info: [{"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-bb481848-5207-4f0b-b56e-8a48bde425f8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:28 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:29 user nova-compute[75438]: WARNING nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:16:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing instance network info cache due to event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:16:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updated VIF entry in instance network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing instance network info cache due to event network-changed-3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Acquiring lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Acquired lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Refreshing network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updated VIF entry in instance network info cache for port 3ab12034-c674-490a-be6d-db79cecc5b53. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [{"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Releasing lock "refresh_cache-f2c26e99-e089-49f5-9499-6bf035067512" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:30 user nova-compute[75438]: WARNING nova.compute.manager [req-6bcb0f80-c61b-4c8f-8c1f-679b3a62775b req-6f81bce8-3c57-47b1-918d-30c8d544db4d service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-b5bcb390-cb04-4d51-b501-a19c676e4b6e req-8772c8a0-99fd-4026-9faa-3341a89b2ac3 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b5bcb390-cb04-4d51-b501-a19c676e4b6e req-8772c8a0-99fd-4026-9faa-3341a89b2ac3 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b5bcb390-cb04-4d51-b501-a19c676e4b6e req-8772c8a0-99fd-4026-9faa-3341a89b2ac3 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b5bcb390-cb04-4d51-b501-a19c676e4b6e req-8772c8a0-99fd-4026-9faa-3341a89b2ac3 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-b5bcb390-cb04-4d51-b501-a19c676e4b6e req-8772c8a0-99fd-4026-9faa-3341a89b2ac3 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:31 user nova-compute[75438]: WARNING nova.compute.manager [req-b5bcb390-cb04-4d51-b501-a19c676e4b6e req-8772c8a0-99fd-4026-9faa-3341a89b2ac3 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:16:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a492018d-3f8a-45f0-ad66-d95ab565f409 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:16:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7348MB free_disk=24.919677734375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a3b47518-63f5-4a38-834d-5627bec3892d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:16:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:36 user nova-compute[75438]: INFO nova.compute.manager [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Rescuing
Nov 09 02:16:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:16:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:16:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:16:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:16:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:16:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-eaa9fbbd-48b4-4523-bb1b-c15ba6568354 req-b58fb833-89f6-4265-afb3-fd4e2d1b9d4a service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eaa9fbbd-48b4-4523-bb1b-c15ba6568354 req-b58fb833-89f6-4265-afb3-fd4e2d1b9d4a service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eaa9fbbd-48b4-4523-bb1b-c15ba6568354 req-b58fb833-89f6-4265-afb3-fd4e2d1b9d4a service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eaa9fbbd-48b4-4523-bb1b-c15ba6568354 req-b58fb833-89f6-4265-afb3-fd4e2d1b9d4a service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-eaa9fbbd-48b4-4523-bb1b-c15ba6568354 req-b58fb833-89f6-4265-afb3-fd4e2d1b9d4a service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:37 user nova-compute[75438]: WARNING nova.compute.manager [req-eaa9fbbd-48b4-4523-bb1b-c15ba6568354 req-b58fb833-89f6-4265-afb3-fd4e2d1b9d4a service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance destroyed successfully.
Nov 09 02:16:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Attempting a stable device rescue
Nov 09 02:16:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75438) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:16:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Creating image(s)
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "/opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'trusted_certs' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "34be2019f59ca5ac3118a0cda748f54cee53f7e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "34be2019f59ca5ac3118a0cda748f54cee53f7e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:38 user nova-compute[75438]: DEBUG nova.virt.images [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] 574094d4-9248-4fcf-8fa8-fa41840ee858 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:16:38 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:16:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.part /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.part /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.converted" returned: 0 in 0.255s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.compute.manager [req-13a462b2-d433-499d-b25d-46e9d7012c7a req-3e87c767-8e5c-4b73-b308-589c5e448abb service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "34be2019f59ca5ac3118a0cda748f54cee53f7e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.657s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "34be2019f59ca5ac3118a0cda748f54cee53f7e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "34be2019f59ca5ac3118a0cda748f54cee53f7e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0 --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0,backing_fmt=raw /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0,backing_fmt=raw /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue" returned: 0 in 0.052s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "34be2019f59ca5ac3118a0cda748f54cee53f7e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'migration_context' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<074d5809-da5f-4158-83e1-651c8518efaa> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Start _get_guest_xml network_info=[{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "vif_mac": "fa:16:3e:be:3b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '574094d4-9248-4fcf-8fa8-fa41840ee858', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'f756f7fa-b235-406d-86cd-8d96ab00094a', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '074d5809-da5f-4158-83e1-651c8518efaa', 'attached_at': '', 'detached_at': '', 'volume_id': '3b7a65b1-5262-4943-b932-ae673dbf5d13', 'serial': '3b7a65b1-5262-4943-b932-ae673dbf5d13'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'resources' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<074d5809-da5f-4158-83e1-651c8518efaa> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'numa_topology' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<074d5809-da5f-4158-83e1-651c8518efaa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:16:39 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'vcpu_model' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<074d5809-da5f-4158-83e1-651c8518efaa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:16:39 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:16:39 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad99dc-9c5a-4fde-9e35-4fd29b8c440c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pZIcvDzU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 02:16:39 user nova-compute[75438]: node.name = iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:16:39 user nova-compute[75438]: node.tpgt = -1
Nov 09 02:16:39 user nova-compute[75438]: node.startup = automatic
Nov 09 02:16:39 user nova-compute[75438]: node.leading_login = No
Nov 09 02:16:39 user nova-compute[75438]: iface.iscsi_ifacename = default
Nov 09 02:16:39 user nova-compute[75438]: iface.net_ifacename = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.ipaddress = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.prefix_len = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.hwaddress = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.transport_name = tcp
Nov 09 02:16:39 user nova-compute[75438]: iface.initiatorname = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.vlan_id = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.vlan_priority = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.vlan_state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.iface_num = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.mtu = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.port = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.bootproto = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.subnet_mask = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.gateway = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_alt_client_id = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_dns = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_learn_iqn = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_vendor_id_state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_vendor_id = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.dhcp_slp_da = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.fragmentation = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.gratuitous_arp = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.incoming_forwarding = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.tos_state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.tos = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.ttl = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.delayed_ack = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.tcp_nagle = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.tcp_wsf_state = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.tcp_wsf = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.tcp_timer_scale = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.tcp_timestamp = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.redirect = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.def_task_mgmt_timeout = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.header_digest = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.data_digest = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.immediate_data = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.initial_r2t = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.data_seq_inorder = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.data_pdu_inorder = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.erl = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.max_receive_data_len = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.first_burst_len = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.max_outstanding_r2t = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.max_burst_len = 0
Nov 09 02:16:39 user nova-compute[75438]: iface.chap_auth = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.bidi_chap = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.strict_login_compliance = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.discovery_auth = <empty>
Nov 09 02:16:39 user nova-compute[75438]: iface.discovery_logout = <empty>
Nov 09 02:16:39 user nova-compute[75438]: node.discovery_address = <empty>
Nov 09 02:16:39 user nova-compute[75438]: node.discovery_port = 0
Nov 09 02:16:39 user nova-compute[75438]: node.discovery_type = static
Nov 09 02:16:39 user nova-compute[75438]: node.session.initial_cmdsn = 0
Nov 09 02:16:39 user nova-compute[75438]: node.session.initial_login_retry_max = 8
Nov 09 02:16:39 user nova-compute[75438]: node.session.xmit_thread_priority = -20
Nov 09 02:16:39 user nova-compute[75438]: node.session.cmds_max = 128
Nov 09 02:16:39 user nova-compute[75438]: node.session.queue_depth = 32
Nov 09 02:16:39 user nova-compute[75438]: node.session.nr_sessions = 1
Nov 09 02:16:39 user nova-compute[75438]: node.session.auth.authmethod = CHAP
Nov 09 02:16:39 user nova-compute[75438]: node.session.auth.username = pZIcvDzU
Nov 09 02:16:39 user nova-compute[75438]: node.session.auth.password = ***
Nov 09 02:16:39 user nova-compute[75438]: node.session.auth.username_in = <empty>
Nov 09 02:16:39 user nova-compute[75438]: node.session.auth.password_in = <empty>
Nov 09 02:16:39 user nova-compute[75438]: node.session.auth.chap_algs = MD5
Nov 09 02:16:39 user nova-compute[75438]: node.session.timeo.replacement_timeout = 120
Nov 09 02:16:39 user nova-compute[75438]: node.session.err_timeo.abort_timeout = 15
Nov 09 02:16:39 user nova-compute[75438]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 02:16:39 user nova-compute[75438]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 02:16:39 user nova-compute[75438]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.FastAbort = Yes
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.InitialR2T = No
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.ImmediateData = Yes
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.MaxConnections = 1
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 02:16:39 user nova-compute[75438]: node.session.iscsi.ERL = 0
Nov 09 02:16:39 user nova-compute[75438]: node.session.scan = manual
Nov 09 02:16:39 user nova-compute[75438]: node.session.reopen_max = 0
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].address = 172.16.0.220
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].port = 3260
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].startup = manual
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].tcp.window_size = 524288
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].tcp.type_of_service = 0
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].timeo.logout_timeout = 15
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].timeo.login_timeout = 15
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].timeo.auth_timeout = 45
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].iscsi.DataDigest = None
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].iscsi.IFMarker = No
Nov 09 02:16:39 user nova-compute[75438]: node.conn[0].iscsi.OFMarker = No
Nov 09 02:16:39 user nova-compute[75438]: # END RECORD
Nov 09 02:16:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace26b7-23f8-4149-860a-559e10d8df79]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60fb0b2-8c3c-4e9c-b98a-c2092f60e869]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZIcvDzU {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZIcvDzU" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2668329-c1dd-488e-b803-a2a899b4ae2f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pZIcvDzU'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd76edfe-711c-4c7c-afa8-7d10e2b4ad4e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee38b95-ae99-4995-9f93-287a0f5067d9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:16:39 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:16:39 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:16:39 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:16:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:16:39 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:16:39 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:16:39 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:16:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.172s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] HCTL ('37', '0', '0', 0) found on session 25 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3284574d-9df6-49a2-9fd6-5915e943c596]: (4, ('0 0 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching for a device in session 25 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23662616366633332', 'path': '/dev/sdf'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662616366633332', 'path': '/dev/sdf'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1756521678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1756521678',id=24,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-83kov24h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:14:46Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=074d5809-da5f-4158-83e1-651c8518efaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "vif_mac": "fa:16:3e:be:3b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "vif_mac": "fa:16:3e:be:3b:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:16:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'pci_devices' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<074d5809-da5f-4158-83e1-651c8518efaa> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:16:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:16:40 user nova-compute[75438]:   <uuid>074d5809-da5f-4158-83e1-651c8518efaa</uuid>
Nov 09 02:16:40 user nova-compute[75438]:   <name>instance-00000018</name>
Nov 09 02:16:40 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:16:40 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:16:40 user nova-compute[75438]:   <metadata>
Nov 09 02:16:40 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:16:40 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:16:40 user nova-compute[75438]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1756521678</nova:name>
Nov 09 02:16:40 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:16:39</nova:creationTime>
Nov 09 02:16:40 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:16:40 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:16:40 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:16:40 user nova-compute[75438]:       <nova:owner>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:user uuid="3160dcb696a24d3db8bd3a22064cbd7a">tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member</nova:user>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:project uuid="f7d490c388e64d5fbdeec47eb532482e">tempest-ServerBootFromVolumeStableRescueTest-1794136160</nova:project>
Nov 09 02:16:40 user nova-compute[75438]:       </nova:owner>
Nov 09 02:16:40 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:16:40 user nova-compute[75438]:       <nova:ports>
Nov 09 02:16:40 user nova-compute[75438]:         <nova:port uuid="3de9abc9-2ac0-4e53-926c-bc0731e2c325">
Nov 09 02:16:40 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:16:40 user nova-compute[75438]:         </nova:port>
Nov 09 02:16:40 user nova-compute[75438]:       </nova:ports>
Nov 09 02:16:40 user nova-compute[75438]:     </nova:instance>
Nov 09 02:16:40 user nova-compute[75438]:   </metadata>
Nov 09 02:16:40 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:16:40 user nova-compute[75438]:     <system>
Nov 09 02:16:40 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:16:40 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:16:40 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:16:40 user nova-compute[75438]:       <entry name="serial">074d5809-da5f-4158-83e1-651c8518efaa</entry>
Nov 09 02:16:40 user nova-compute[75438]:       <entry name="uuid">074d5809-da5f-4158-83e1-651c8518efaa</entry>
Nov 09 02:16:40 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:16:40 user nova-compute[75438]:     </system>
Nov 09 02:16:40 user nova-compute[75438]:   </sysinfo>
Nov 09 02:16:40 user nova-compute[75438]:   <os>
Nov 09 02:16:40 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:16:40 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:16:40 user nova-compute[75438]:   </os>
Nov 09 02:16:40 user nova-compute[75438]:   <features>
Nov 09 02:16:40 user nova-compute[75438]:     <acpi/>
Nov 09 02:16:40 user nova-compute[75438]:     <apic/>
Nov 09 02:16:40 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:16:40 user nova-compute[75438]:   </features>
Nov 09 02:16:40 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:16:40 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:16:40 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:16:40 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:16:40 user nova-compute[75438]:   </clock>
Nov 09 02:16:40 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:16:40 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:16:40 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:16:40 user nova-compute[75438]:   </cpu>
Nov 09 02:16:40 user nova-compute[75438]:   <devices>
Nov 09 02:16:40 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:16:40 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:40 user nova-compute[75438]:       <source dev="/dev/sdf"/>
Nov 09 02:16:40 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:16:40 user nova-compute[75438]:       <serial>3b7a65b1-5262-4943-b932-ae673dbf5d13</serial>
Nov 09 02:16:40 user nova-compute[75438]:     </disk>
Nov 09 02:16:40 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:16:40 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:16:40 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue"/>
Nov 09 02:16:40 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:16:40 user nova-compute[75438]:       <boot order="1"/>
Nov 09 02:16:40 user nova-compute[75438]:     </disk>
Nov 09 02:16:40 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:16:40 user nova-compute[75438]:       <mac address="fa:16:3e:be:3b:a4"/>
Nov 09 02:16:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:16:40 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:16:40 user nova-compute[75438]:       <target dev="tap3de9abc9-2a"/>
Nov 09 02:16:40 user nova-compute[75438]:     </interface>
Nov 09 02:16:40 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:16:40 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/console.log" append="off"/>
Nov 09 02:16:40 user nova-compute[75438]:     </serial>
Nov 09 02:16:40 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:16:40 user nova-compute[75438]:     <video>
Nov 09 02:16:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:16:40 user nova-compute[75438]:     </video>
Nov 09 02:16:40 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:16:40 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:16:40 user nova-compute[75438]:     </rng>
Nov 09 02:16:40 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:16:40 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:16:40 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:16:40 user nova-compute[75438]:     </memballoon>
Nov 09 02:16:40 user nova-compute[75438]:   </devices>
Nov 09 02:16:40 user nova-compute[75438]: </domain>
Nov 09 02:16:40 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:16:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance destroyed successfully.
Nov 09 02:16:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:16:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:16:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No VIF found with MAC fa:16:3e:be:3b:a4, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:16:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-a909f7a3-59e7-4142-a490-8a3d1c822948 req-5b2fcae3-6dff-4357-b11c-7eb7886c55b8 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a909f7a3-59e7-4142-a490-8a3d1c822948 req-5b2fcae3-6dff-4357-b11c-7eb7886c55b8 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a909f7a3-59e7-4142-a490-8a3d1c822948 req-5b2fcae3-6dff-4357-b11c-7eb7886c55b8 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a909f7a3-59e7-4142-a490-8a3d1c822948 req-5b2fcae3-6dff-4357-b11c-7eb7886c55b8 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-a909f7a3-59e7-4142-a490-8a3d1c822948 req-5b2fcae3-6dff-4357-b11c-7eb7886c55b8 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:41 user nova-compute[75438]: WARNING nova.compute.manager [req-a909f7a3-59e7-4142-a490-8a3d1c822948 req-5b2fcae3-6dff-4357-b11c-7eb7886c55b8 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 req-01a8c9b1-a206-488e-8e55-0fed3f3bdd04 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event volume-reimaged-dcde84f2-18d7-4352-bdcd-969ba7a227ba {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 req-01a8c9b1-a206-488e-8e55-0fed3f3bdd04 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 req-01a8c9b1-a206-488e-8e55-0fed3f3bdd04 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 req-01a8c9b1-a206-488e-8e55-0fed3f3bdd04 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 req-01a8c9b1-a206-488e-8e55-0fed3f3bdd04 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Processing event volume-reimaged-dcde84f2-18d7-4352-bdcd-969ba7a227ba {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance event wait completed in 52 seconds for volume-reimaged {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:16:43 user nova-compute[75438]: INFO nova.virt.block_device [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Booting with volume dcde84f2-18d7-4352-bdcd-969ba7a227ba at /dev/vda
Nov 09 02:16:43 user nova-compute[75438]: DEBUG os_brick.utils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1224ef-72fc-4699-8528-b44ac410fe58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c048db-730b-49e2-aca0-5d80fabb6398]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6de082-1de1-472d-a344-30ee7cce49c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c249ec4a-6850-4391-9158-649f18fcc74b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:16:43 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b1b35-a019-4146-8569-49bff535aaf8]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG os_brick.utils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating existing volume attachment record: 997a1215-d820-4902-bb0f-8020e6e583ef {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-ef92b84f-dfe6-4d53-9b9c-43ad20a944a2 req-740fdcef-ad4e-4101-b261-9476f0bac74f service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ef92b84f-dfe6-4d53-9b9c-43ad20a944a2 req-740fdcef-ad4e-4101-b261-9476f0bac74f service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ef92b84f-dfe6-4d53-9b9c-43ad20a944a2 req-740fdcef-ad4e-4101-b261-9476f0bac74f service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ef92b84f-dfe6-4d53-9b9c-43ad20a944a2 req-740fdcef-ad4e-4101-b261-9476f0bac74f service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-ef92b84f-dfe6-4d53-9b9c-43ad20a944a2 req-740fdcef-ad4e-4101-b261-9476f0bac74f service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:16:43 user nova-compute[75438]: WARNING nova.compute.manager [req-ef92b84f-dfe6-4d53-9b9c-43ad20a944a2 req-740fdcef-ad4e-4101-b261-9476f0bac74f service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state rescuing.
Nov 09 02:16:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-01f16ca7-9fe2-4f04-934c-0d011c36590b tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:16:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWBSKOAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:16:47 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:16:47 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:16:47 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc894f02-6c69-4990-9936-a30450bd8b79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:16:47 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b94caa-0474-407d-899c-76095e36d586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d] added
Nov 09 02:16:47 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35b2cdc-a391-41bc-beec-8c75a5e900d1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a47c11-59db-4ee9-85e2-d030194d27c2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWBSKOAs {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HWBSKOAs" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d7a551-1262-4b87-9ef9-1ad84b108e44]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HWBSKOAs'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee0d72-d882-4be0-896e-15df44004b2d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83bb86e-3031-48d3-95cc-b2a68df98ed6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:16:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:16:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764d0c1-7783-43c9-9c4a-6d0388623e2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260]
Nov 09 02:16:48 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260] successful.
Nov 09 02:16:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[385069dc-e53c-455a-a117-c796e399c5f6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c0359-2c74-4e50-ba4d-74dd99f9dfc9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d (non-flash)
Nov 09 02:16:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:16:48 user nova-compute[75438]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d (non-flash)
Nov 09 02:16:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0fc9ca-bedd-404b-bea4-2bba324a9599]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:16:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWBSKOAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26335626638636431', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335626638636431', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'flavor' on Instance uuid 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:16:49 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:49 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:16:49 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:16:49 user nova-compute[75438]:   <serial>16f2856e-bc93-45b0-9cda-6e58273e516d</serial>
Nov 09 02:16:49 user nova-compute[75438]: </disk>
Nov 09 02:16:49 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No VIF found with MAC fa:16:3e:86:53:45, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:16:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cb9f28a0-cf45-4831-93a4-605785ffaac1 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.833s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:16:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:51 user nova-compute[75438]: INFO nova.compute.manager [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Detaching volume 16f2856e-bc93-45b0-9cda-6e58273e516d
Nov 09 02:16:51 user nova-compute[75438]: INFO nova.virt.block_device [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Attempting to driver detach volume 16f2856e-bc93-45b0-9cda-6e58273e516d from mountpoint /dev/vdb
Nov 09 02:16:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Attempting to detach device vdb from instance 350eb030-6104-46bb-9ffe-da6dcb7244ee from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:16:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:16:51 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:51 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:16:51 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:16:51 user nova-compute[75438]:   <serial>16f2856e-bc93-45b0-9cda-6e58273e516d</serial>
Nov 09 02:16:51 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:16:51 user nova-compute[75438]: </disk>
Nov 09 02:16:51 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:16:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully detached device vdb from instance 350eb030-6104-46bb-9ffe-da6dcb7244ee from the persistent domain config.
Nov 09 02:16:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 350eb030-6104-46bb-9ffe-da6dcb7244ee from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:16:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:16:51 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:51 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:16:51 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:16:51 user nova-compute[75438]:   <serial>16f2856e-bc93-45b0-9cda-6e58273e516d</serial>
Nov 09 02:16:51 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:16:51 user nova-compute[75438]: </disk>
Nov 09 02:16:51 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:16:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:16:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:16:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:16:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:16:59 user nova-compute[75438]: INFO nova.compute.manager [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Detaching volume 5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:16:59 user nova-compute[75438]: INFO nova.virt.block_device [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Attempting to driver detach volume 5a9cc239-1892-42d3-9b7b-846500825f63 from mountpoint /dev/vdb
Nov 09 02:16:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Attempting to detach device vdb from instance f2c26e99-e089-49f5-9499-6bf035067512 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:16:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:16:59 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:59 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:16:59 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:16:59 user nova-compute[75438]:   <serial>5a9cc239-1892-42d3-9b7b-846500825f63</serial>
Nov 09 02:16:59 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:16:59 user nova-compute[75438]: </disk>
Nov 09 02:16:59 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:16:59 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Successfully detached device vdb from instance f2c26e99-e089-49f5-9499-6bf035067512 from the persistent domain config.
Nov 09 02:16:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2c26e99-e089-49f5-9499-6bf035067512 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:16:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:16:59 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:16:59 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:16:59 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:16:59 user nova-compute[75438]:   <serial>5a9cc239-1892-42d3-9b7b-846500825f63</serial>
Nov 09 02:16:59 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:16:59 user nova-compute[75438]: </disk>
Nov 09 02:16:59 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:17:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:17:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:07 user nova-compute[75438]: INFO nova.compute.manager [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Unshelving
Nov 09 02:17:07 user nova-compute[75438]: INFO nova.virt.block_device [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Booting with volume 09015b7e-a26a-4bb8-afc1-972768386128 at /dev/vda
Nov 09 02:17:07 user nova-compute[75438]: DEBUG os_brick.utils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fb10de-a66b-42a0-95bf-6240cf3d5e09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45604fc-22be-43ec-8a95-19a356a3306a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[665df3a9-5b4f-4790-bf9b-9923d9c90c8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5515e929-3468-44e2-aa0b-4516a6b21fb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:17:07 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:17:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5262b53-1fc3-4034-a98c-3d5832f89de7]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG os_brick.utils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:17:07 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating existing volume attachment record: fffd5b72-eccd-4978-958e-018024a40aa4 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:17:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-changed-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Refreshing instance network info cache due to event network-changed-4228b3fa-1303-4e30-85d4-dcba154f828b. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] Acquiring lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] Acquired lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:17:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Refreshing network info cache for port 4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:17:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updated VIF entry in instance network info cache for port 4228b3fa-1303-4e30-85d4-dcba154f828b. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:17:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating instance_info_cache with network_info: [{"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-128f18a7-5459-4eee-90e5-cefd6e17d5a2 req-195e50db-1152-4e26-b883-5514d536efa2 service nova] Releasing lock "refresh_cache-3ce04a63-a5b1-4945-82f9-ebd03614f722" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:17:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 350eb030-6104-46bb-9ffe-da6dcb7244ee is timed out.
Nov 09 02:17:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully detached device vdb from instance 350eb030-6104-46bb-9ffe-da6dcb7244ee from the live domain config.
Nov 09 02:17:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HWBSKOAs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:17:12 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4914e0-32b8-40de-b077-2deb33e5dd65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:17:12 user nova-compute[75438]: No targets found.
Nov 09 02:17:12 user nova-compute[75438]: iSNS:
Nov 09 02:17:12 user nova-compute[75438]: No targets found.
Nov 09 02:17:12 user nova-compute[75438]: STATIC:
Nov 09 02:17:12 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:17:12 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:12 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:12 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:17:12 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:12 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:12 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d
Nov 09 02:17:12 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:12 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:12 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:17:12 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:12 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:12 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:17:12 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:12 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:12 user nova-compute[75438]: FIRMWARE:
Nov 09 02:17:12 user nova-compute[75438]: No targets found.
Nov 09 02:17:12 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:17:12 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:17:12 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4797367-f7b1-4012-8954-29951ac9ed91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dc42ba-07c8-47d6-8621-6b576c6a368a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d (non-flash)
Nov 09 02:17:12 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:12 user nova-compute[75438]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d (non-flash)
Nov 09 02:17:12 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0430de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f5b3e6-f2d3-4b18-b7fe-5f7f625d815c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f125ea-59d0-4645-821d-99ba8da74335]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15a84a2-ca9a-4813-9276-48f4b7bac54d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7571de1-db63-439f-91fd-7d2b080b83a4]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c946ff7-6337-404d-9f18-85ab1fb2ad0d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8259045-8f99-488c-a5a1-d9ec23fb5b40]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260]
Nov 09 02:17:12 user nova-compute[75438]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d, portal: 172.16.0.220,3260] successful.
Nov 09 02:17:12 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16f2856e-bc93-45b0-9cda-6e58273e516d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573a365-683f-4cd0-a3e3-1fc1e80a33ae]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] <== disconnect_volume: return (368ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:17:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:17:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:20 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2c26e99-e089-49f5-9499-6bf035067512 is timed out.
Nov 09 02:17:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Successfully detached device vdb from instance f2c26e99-e089-49f5-9499-6bf035067512 from the live domain config.
Nov 09 02:17:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wItPByJU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:17:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a05ad10-8771-4320-a6d8-200ea9ebf91c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:17:20 user nova-compute[75438]: No targets found.
Nov 09 02:17:20 user nova-compute[75438]: iSNS:
Nov 09 02:17:20 user nova-compute[75438]: No targets found.
Nov 09 02:17:20 user nova-compute[75438]: STATIC:
Nov 09 02:17:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63
Nov 09 02:17:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:17:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:17:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:17:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:17:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:17:20 user nova-compute[75438]: FIRMWARE:
Nov 09 02:17:20 user nova-compute[75438]: No targets found.
Nov 09 02:17:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:17:20 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:17:20 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5877052-84f9-45f0-be21-893501a85ff3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[26899585-ee7f-411d-b047-ad56f8cae8b3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:20 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:17:20 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:20 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:20 user nova-compute[75438]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 (non-flash)
Nov 09 02:17:20 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:20 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba2c0f17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63'): ({'sde'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Removing single pathed devices sde {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e03094-590c-4093-9c17-6305d07271b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[877dbe9f-4b1f-4ddd-83ed-c6e3c0307c84]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Flushing IO for device /dev/sde {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac4a8c4-d7e3-4770-a3e3-68dccc6d6404]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d759fbd-8e76-4393-be37-798e6f900223]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4125a55d-2981-4cbb-a5fc-94f011e3facb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de1387a-bbcc-4ef9-a6e5-a4e354c65f49]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260]
Nov 09 02:17:20 user nova-compute[75438]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63, portal: 172.16.0.220,3260] successful.
Nov 09 02:17:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a9cc239-1892-42d3-9b7b-846500825f63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec61769f-4761-4286-94e4-9a3d4156a0fc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] <== disconnect_volume: return (325ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:17:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:17:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:17:22 user nova-compute[75438]: INFO nova.compute.claims [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Claim successful on node user
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.network.neutron [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:17:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.policy [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb053462f626448db04acd63d8489bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e35bd9611ea14910ab54504a8a6f0f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:17:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Creating image(s)
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "/opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "/opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "/opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk 1073741824" returned: 0 in 0.050s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG nova.network.neutron [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Successfully created port: 9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.241s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Cannot resize image /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Ensure instance console log exists: /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Successfully updated port: 9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquired lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-changed-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Refreshing instance network info cache due to event network-changed-9cbd945f-fb48-48b9-ba20-178b54a7f26b. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] Acquiring lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating instance_info_cache with network_info: [{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Releasing lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Instance network_info: |[{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] Acquired lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Refreshing network info cache for port 9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Start _get_guest_xml network_info=[{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:17:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:17:24 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-964764817',display_name='tempest-SnapshotDataIntegrityTests-server-964764817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-964764817',id=27,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQz3I9PCJZnlZhBeBglpNn95TVl6X2Tf2QmhxfnwWZCjNdYgNa0ty89v4Z9QJhwr88zhqIZhBP+JVf+RUq8ildIwsMtxhW+lRmudKigclTLRkbQOHOU08ZE/vyfe0ch1w==',key_name='tempest-keypair-1705516396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35bd9611ea14910ab54504a8a6f0f7a',ramdisk_id='',reservation_id='r-whg6gcsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-788108331',owner_user_name='tempest-SnapshotDataIntegrityTests-788108331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb053462f626448db04acd63d8489bdd',uuid=77276a3a-25bc-4fc4-978b-8597ce732f2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Converting VIF {"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.objects.instance [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'pci_devices' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:17:24 user nova-compute[75438]:   <uuid>77276a3a-25bc-4fc4-978b-8597ce732f2e</uuid>
Nov 09 02:17:24 user nova-compute[75438]:   <name>instance-0000001b</name>
Nov 09 02:17:24 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:17:24 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:17:24 user nova-compute[75438]:   <metadata>
Nov 09 02:17:24 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:17:24 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:17:24 user nova-compute[75438]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-964764817</nova:name>
Nov 09 02:17:24 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:17:24</nova:creationTime>
Nov 09 02:17:24 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:17:24 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:17:24 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:17:24 user nova-compute[75438]:       <nova:owner>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:user uuid="cb053462f626448db04acd63d8489bdd">tempest-SnapshotDataIntegrityTests-788108331-project-member</nova:user>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:project uuid="e35bd9611ea14910ab54504a8a6f0f7a">tempest-SnapshotDataIntegrityTests-788108331</nova:project>
Nov 09 02:17:24 user nova-compute[75438]:       </nova:owner>
Nov 09 02:17:24 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:17:24 user nova-compute[75438]:       <nova:ports>
Nov 09 02:17:24 user nova-compute[75438]:         <nova:port uuid="9cbd945f-fb48-48b9-ba20-178b54a7f26b">
Nov 09 02:17:24 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:17:24 user nova-compute[75438]:         </nova:port>
Nov 09 02:17:24 user nova-compute[75438]:       </nova:ports>
Nov 09 02:17:24 user nova-compute[75438]:     </nova:instance>
Nov 09 02:17:24 user nova-compute[75438]:   </metadata>
Nov 09 02:17:24 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:17:24 user nova-compute[75438]:     <system>
Nov 09 02:17:24 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:17:24 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:17:24 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:17:24 user nova-compute[75438]:       <entry name="serial">77276a3a-25bc-4fc4-978b-8597ce732f2e</entry>
Nov 09 02:17:24 user nova-compute[75438]:       <entry name="uuid">77276a3a-25bc-4fc4-978b-8597ce732f2e</entry>
Nov 09 02:17:24 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:17:24 user nova-compute[75438]:     </system>
Nov 09 02:17:24 user nova-compute[75438]:   </sysinfo>
Nov 09 02:17:24 user nova-compute[75438]:   <os>
Nov 09 02:17:24 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:17:24 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:17:24 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:17:24 user nova-compute[75438]:   </os>
Nov 09 02:17:24 user nova-compute[75438]:   <features>
Nov 09 02:17:24 user nova-compute[75438]:     <acpi/>
Nov 09 02:17:24 user nova-compute[75438]:     <apic/>
Nov 09 02:17:24 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:17:24 user nova-compute[75438]:   </features>
Nov 09 02:17:24 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:17:24 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:17:24 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:17:24 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:17:24 user nova-compute[75438]:   </clock>
Nov 09 02:17:24 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:17:24 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:17:24 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:17:24 user nova-compute[75438]:   </cpu>
Nov 09 02:17:24 user nova-compute[75438]:   <devices>
Nov 09 02:17:24 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:17:24 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:17:24 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk"/>
Nov 09 02:17:24 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:17:24 user nova-compute[75438]:     </disk>
Nov 09 02:17:24 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:17:24 user nova-compute[75438]:       <mac address="fa:16:3e:03:d7:69"/>
Nov 09 02:17:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:17:24 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:17:24 user nova-compute[75438]:       <target dev="tap9cbd945f-fb"/>
Nov 09 02:17:24 user nova-compute[75438]:     </interface>
Nov 09 02:17:24 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:17:24 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/console.log" append="off"/>
Nov 09 02:17:24 user nova-compute[75438]:     </serial>
Nov 09 02:17:24 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:17:24 user nova-compute[75438]:     <video>
Nov 09 02:17:24 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:17:24 user nova-compute[75438]:     </video>
Nov 09 02:17:24 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:17:24 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:17:24 user nova-compute[75438]:     </rng>
Nov 09 02:17:24 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:17:24 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:17:24 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:17:24 user nova-compute[75438]:     </memballoon>
Nov 09 02:17:24 user nova-compute[75438]:   </devices>
Nov 09 02:17:24 user nova-compute[75438]: </domain>
Nov 09 02:17:24 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-964764817',display_name='tempest-SnapshotDataIntegrityTests-server-964764817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-964764817',id=27,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQz3I9PCJZnlZhBeBglpNn95TVl6X2Tf2QmhxfnwWZCjNdYgNa0ty89v4Z9QJhwr88zhqIZhBP+JVf+RUq8ildIwsMtxhW+lRmudKigclTLRkbQOHOU08ZE/vyfe0ch1w==',key_name='tempest-keypair-1705516396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e35bd9611ea14910ab54504a8a6f0f7a',ramdisk_id='',reservation_id='r-whg6gcsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-788108331',owner_user_name='tempest-SnapshotDataIntegrityTests-788108331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb053462f626448db04acd63d8489bdd',uuid=77276a3a-25bc-4fc4-978b-8597ce732f2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Converting VIF {"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG os_vif [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ff210b4-fed5-56b6-8b4b-1fb94144ed38', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cbd945f-fb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cbd945f-fb, col_values=(('qos', UUID('b6d1214d-8dc3-4672-9516-46fa71ee59f4')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cbd945f-fb, col_values=(('external_ids', {'iface-id': '9cbd945f-fb48-48b9-ba20-178b54a7f26b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:d7:69', 'vm-uuid': '77276a3a-25bc-4fc4-978b-8597ce732f2e'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:24 user nova-compute[75438]: INFO os_vif [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb')
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No VIF found with MAC fa:16:3e:03:d7:69, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updated VIF entry in instance network info cache for port 9cbd945f-fb48-48b9-ba20-178b54a7f26b. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating instance_info_cache with network_info: [{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-033ef968-213d-4c52-8a65-bb235673391e req-459eb849-8213-405e-aba0-5375ac27cb76 service nova] Releasing lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:17:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-701eb667-b8b2-4884-af44-8d09792e5b02 req-cd8e2bad-f219-409a-9263-6d4463e10b04 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-701eb667-b8b2-4884-af44-8d09792e5b02 req-cd8e2bad-f219-409a-9263-6d4463e10b04 service nova] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-701eb667-b8b2-4884-af44-8d09792e5b02 req-cd8e2bad-f219-409a-9263-6d4463e10b04 service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-701eb667-b8b2-4884-af44-8d09792e5b02 req-cd8e2bad-f219-409a-9263-6d4463e10b04 service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-701eb667-b8b2-4884-af44-8d09792e5b02 req-cd8e2bad-f219-409a-9263-6d4463e10b04 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] No waiting events found dispatching network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:26 user nova-compute[75438]: WARNING nova.compute.manager [req-701eb667-b8b2-4884-af44-8d09792e5b02 req-cd8e2bad-f219-409a-9263-6d4463e10b04 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received unexpected event network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b for instance with vm_state building and task_state spawning.
Nov 09 02:17:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:27 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:27 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:17:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Instance spawned successfully.
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc8aaa53-0d4c-420f-b3b8-cafaac9ca9cc req-aca83a08-1a81-4862-9b22-cf29400799b2 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8aaa53-0d4c-420f-b3b8-cafaac9ca9cc req-aca83a08-1a81-4862-9b22-cf29400799b2 service nova] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8aaa53-0d4c-420f-b3b8-cafaac9ca9cc req-aca83a08-1a81-4862-9b22-cf29400799b2 service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc8aaa53-0d4c-420f-b3b8-cafaac9ca9cc req-aca83a08-1a81-4862-9b22-cf29400799b2 service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc8aaa53-0d4c-420f-b3b8-cafaac9ca9cc req-aca83a08-1a81-4862-9b22-cf29400799b2 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] No waiting events found dispatching network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:28 user nova-compute[75438]: WARNING nova.compute.manager [req-dc8aaa53-0d4c-420f-b3b8-cafaac9ca9cc req-aca83a08-1a81-4862-9b22-cf29400799b2 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received unexpected event network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b for instance with vm_state building and task_state spawning.
Nov 09 02:17:28 user nova-compute[75438]: INFO nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:28 user nova-compute[75438]: INFO nova.compute.manager [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Took 6.41 seconds to build instance.
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ed1762c5-4f7a-401e-8dcd-961585d2b174 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.534s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'flavor' on Instance uuid 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7515aaa4-71c5-4184-99d7-975c54501b02 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 37.710s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG nova.objects.instance [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:17:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Creating image(s)
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Ensure instance console log exists: /opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Start _get_guest_xml network_info=[{"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '997a1215-d820-4902-bb0f-8020e6e583ef', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84a69147-dc3e-4bd3-83e0-4656d2d8ea16', 'attached_at': '', 'detached_at': '', 'volume_id': 'dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'serial': 'dcde84f2-18d7-4352-bdcd-969ba7a227ba'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:17:30 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 02:17:30 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:17:30 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:17:30 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:17:30 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:30 user nova-compute[75438]: INFO nova.compute.manager [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attaching volume abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e to /dev/vdb
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5eb7d7-766c-4d6b-9552-682d40dfac94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:17:30 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8378faa-8753-4d2b-bc46-f50022a4c9eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba] added
Nov 09 02:17:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4edbca0-c431-44f1-a319-9544c676a799]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.utils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a473e706-eba3-4906-9e92-d4c08e6a59c9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdcZEqPr {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c83cdc-531a-49ac-8a2e-e5a710bc1790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdcZEqPr" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46314c-d715-42c3-ba43-efaf0677d88e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdcZEqPr'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9b66fd-a82c-4395-9450-2ab308b67a6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a23a71-d1a3-47fe-91ec-14d9f8c4243c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbc6957-6c2b-4007-8f0f-f1200b5a8a76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a353c-4037-44b4-913d-62eb683c5869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1764ce-0ac2-4388-8ef9-c53f7661f21c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:17:30 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d30350-3380-4fd3-ad4d-a6e7e1ee59c3]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.utils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating existing volume attachment record: 81113e1d-b335-4ea6-8023-4c377afd8163 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[01524224-5776-4c3a-9739-68884d0b73a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]
Nov 09 02:17:30 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.
Nov 09 02:17:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a74ecb-116f-4366-9ff7-ed178a202597]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4eb470-70ac-4c16-b8b7-88e615e957d2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:17:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:30 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:17:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c995b7-81a7-4acf-8f73-e344633b2d61]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23461663336336461', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461663336336461', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1844743210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-594334493',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5tur4KHsYWmYr5apfE+nTJUUV0P9vgLOi9qtfxKdVRfN7Z/ln6xZmAnG5/s4YQ5a62+x2A+XbtT/mc9SdFYtWXrp+O6WCdeNIwExdi3ksz4Re8DoIPfr3LiQfM71S8A==',key_name='tempest-keypair-959261134',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b90a39ccf04453387605602fd424452',ramdisk_id='',reservation_id='r-f42cnvuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1084561406',owner_user_name='tempest-ServerActionsV293TestJSON-1084561406-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d42bf053761842be974389361ec9f89e',uuid=84a69147-dc3e-4bd3-83e0-4656d2d8ea16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converting VIF {"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:17:31 user nova-compute[75438]:   <uuid>84a69147-dc3e-4bd3-83e0-4656d2d8ea16</uuid>
Nov 09 02:17:31 user nova-compute[75438]:   <name>instance-00000017</name>
Nov 09 02:17:31 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:17:31 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:17:31 user nova-compute[75438]:   <metadata>
Nov 09 02:17:31 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:17:31 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:17:31 user nova-compute[75438]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1844743210</nova:name>
Nov 09 02:17:31 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:17:30</nova:creationTime>
Nov 09 02:17:31 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:17:31 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:17:31 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:17:31 user nova-compute[75438]:       <nova:owner>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:user uuid="d42bf053761842be974389361ec9f89e">tempest-ServerActionsV293TestJSON-1084561406-project-member</nova:user>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:project uuid="4b90a39ccf04453387605602fd424452">tempest-ServerActionsV293TestJSON-1084561406</nova:project>
Nov 09 02:17:31 user nova-compute[75438]:       </nova:owner>
Nov 09 02:17:31 user nova-compute[75438]:       <nova:ports>
Nov 09 02:17:31 user nova-compute[75438]:         <nova:port uuid="2b7ebd43-e9ca-4321-8276-0a43621c89a1">
Nov 09 02:17:31 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 09 02:17:31 user nova-compute[75438]:         </nova:port>
Nov 09 02:17:31 user nova-compute[75438]:       </nova:ports>
Nov 09 02:17:31 user nova-compute[75438]:     </nova:instance>
Nov 09 02:17:31 user nova-compute[75438]:   </metadata>
Nov 09 02:17:31 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:17:31 user nova-compute[75438]:     <system>
Nov 09 02:17:31 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:17:31 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:17:31 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:17:31 user nova-compute[75438]:       <entry name="serial">84a69147-dc3e-4bd3-83e0-4656d2d8ea16</entry>
Nov 09 02:17:31 user nova-compute[75438]:       <entry name="uuid">84a69147-dc3e-4bd3-83e0-4656d2d8ea16</entry>
Nov 09 02:17:31 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:17:31 user nova-compute[75438]:     </system>
Nov 09 02:17:31 user nova-compute[75438]:   </sysinfo>
Nov 09 02:17:31 user nova-compute[75438]:   <os>
Nov 09 02:17:31 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:17:31 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:17:31 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:17:31 user nova-compute[75438]:   </os>
Nov 09 02:17:31 user nova-compute[75438]:   <features>
Nov 09 02:17:31 user nova-compute[75438]:     <acpi/>
Nov 09 02:17:31 user nova-compute[75438]:     <apic/>
Nov 09 02:17:31 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:17:31 user nova-compute[75438]:   </features>
Nov 09 02:17:31 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:17:31 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:17:31 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:17:31 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:17:31 user nova-compute[75438]:   </clock>
Nov 09 02:17:31 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:17:31 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:17:31 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:17:31 user nova-compute[75438]:   </cpu>
Nov 09 02:17:31 user nova-compute[75438]:   <devices>
Nov 09 02:17:31 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:17:31 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:17:31 user nova-compute[75438]:       <source dev="/dev/sdd"/>
Nov 09 02:17:31 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:17:31 user nova-compute[75438]:       <serial>dcde84f2-18d7-4352-bdcd-969ba7a227ba</serial>
Nov 09 02:17:31 user nova-compute[75438]:     </disk>
Nov 09 02:17:31 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:17:31 user nova-compute[75438]:       <mac address="fa:16:3e:38:0d:bb"/>
Nov 09 02:17:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:17:31 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:17:31 user nova-compute[75438]:       <target dev="tap2b7ebd43-e9"/>
Nov 09 02:17:31 user nova-compute[75438]:     </interface>
Nov 09 02:17:31 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:17:31 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16/console.log" append="off"/>
Nov 09 02:17:31 user nova-compute[75438]:     </serial>
Nov 09 02:17:31 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:17:31 user nova-compute[75438]:     <video>
Nov 09 02:17:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:17:31 user nova-compute[75438]:     </video>
Nov 09 02:17:31 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:17:31 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:17:31 user nova-compute[75438]:     </rng>
Nov 09 02:17:31 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:17:31 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:17:31 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:17:31 user nova-compute[75438]:     </memballoon>
Nov 09 02:17:31 user nova-compute[75438]:   </devices>
Nov 09 02:17:31 user nova-compute[75438]: </domain>
Nov 09 02:17:31 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1844743210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-594334493',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5tur4KHsYWmYr5apfE+nTJUUV0P9vgLOi9qtfxKdVRfN7Z/ln6xZmAnG5/s4YQ5a62+x2A+XbtT/mc9SdFYtWXrp+O6WCdeNIwExdi3ksz4Re8DoIPfr3LiQfM71S8A==',key_name='tempest-keypair-959261134',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4b90a39ccf04453387605602fd424452',ramdisk_id='',reservation_id='r-f42cnvuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1084561406',owner_user_name='tempest-ServerActionsV293TestJSON-1084561406-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d42bf053761842be974389361ec9f89e',uuid=84a69147-dc3e-4bd3-83e0-4656d2d8ea16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converting VIF {"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG os_vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2733f8e-5bb9-5ca4-905c-409539115c67', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b7ebd43-e9, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b7ebd43-e9, col_values=(('qos', UUID('cab60fe0-9118-4569-8834-8f32d8798354')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b7ebd43-e9, col_values=(('external_ids', {'iface-id': '2b7ebd43-e9ca-4321-8276-0a43621c89a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:0d:bb', 'vm-uuid': '84a69147-dc3e-4bd3-83e0-4656d2d8ea16'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:31 user nova-compute[75438]: INFO os_vif [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9')
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:17:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] No VIF found with MAC fa:16:3e:38:0d:bb, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-51330a34-995a-45e9-aa59-28581208d61e req-df0dfb99-26ff-4a40-9c8f-ca34d76b038d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-51330a34-995a-45e9-aa59-28581208d61e req-df0dfb99-26ff-4a40-9c8f-ca34d76b038d service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-51330a34-995a-45e9-aa59-28581208d61e req-df0dfb99-26ff-4a40-9c8f-ca34d76b038d service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-51330a34-995a-45e9-aa59-28581208d61e req-df0dfb99-26ff-4a40-9c8f-ca34d76b038d service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-51330a34-995a-45e9-aa59-28581208d61e req-df0dfb99-26ff-4a40-9c8f-ca34d76b038d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:33 user nova-compute[75438]: WARNING nova.compute.manager [req-51330a34-995a-45e9-aa59-28581208d61e req-df0dfb99-26ff-4a40-9c8f-ca34d76b038d service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-b4830a69-f10b-419e-932b-4e76b2996fc1 req-6ee97707-111d-4716-83a2-8ab70fa03033 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b4830a69-f10b-419e-932b-4e76b2996fc1 req-6ee97707-111d-4716-83a2-8ab70fa03033 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b4830a69-f10b-419e-932b-4e76b2996fc1 req-6ee97707-111d-4716-83a2-8ab70fa03033 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b4830a69-f10b-419e-932b-4e76b2996fc1 req-6ee97707-111d-4716-83a2-8ab70fa03033 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-b4830a69-f10b-419e-932b-4e76b2996fc1 req-6ee97707-111d-4716-83a2-8ab70fa03033 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:36 user nova-compute[75438]: WARNING nova.compute.manager [req-b4830a69-f10b-419e-932b-4e76b2996fc1 req-6ee97707-111d-4716-83a2-8ab70fa03033 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state active and task_state rebuild_spawning.
Nov 09 02:17:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance spawned successfully.
Nov 09 02:17:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:17:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7114MB free_disk=24.81922149658203GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance f2c26e99-e089-49f5-9499-6bf035067512 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance bb481848-5207-4f0b-b56e-8a48bde425f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a3b47518-63f5-4a38-834d-5627bec3892d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 896758d5-8945-4fb7-a90f-a86084c7fd3a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.785s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.583s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75438) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a4fac245-3e5f-489d-9ac5-ff8190e76e06 tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.117s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:17:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing instance network info cache due to event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [{"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-3be630c7-6913-421f-aa2e-19f3208b12e7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:17:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:17:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updated VIF entry in instance network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:17:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fff7a160-bafd-4399-a0e4-8a7075753cc8 req-a2b5d275-bc3b-495d-86b0-e390bc303e3a service nova] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:17:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing instance network info cache due to event network-changed-e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:17:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] Acquiring lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:17:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] Acquired lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:17:40 user nova-compute[75438]: DEBUG nova.network.neutron [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Refreshing network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:17:41 user nova-compute[75438]: DEBUG nova.network.neutron [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updated VIF entry in instance network info cache for port e62b5ee2-b006-48b2-a038-94869d96fc8a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:17:41 user nova-compute[75438]: DEBUG nova.network.neutron [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [{"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-647b2ed3-745f-4542-849d-230e89acf331 req-7e702428-2d42-4d8c-952d-c3963894582e service nova] Releasing lock "refresh_cache-7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:17:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG nova.objects.instance [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'flavor' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-34159bca-1b1b-4be1-bc83-1f2594af887f tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 42.274s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:42 user nova-compute[75438]: INFO nova.compute.manager [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Terminating instance
Nov 09 02:17:42 user nova-compute[75438]: DEBUG nova.compute.manager [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c051ecc-c5a1-438a-ba2e-3727e44b699c req-af88c757-b809-4977-8511-91f662d0b916 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-vif-unplugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c051ecc-c5a1-438a-ba2e-3727e44b699c req-af88c757-b809-4977-8511-91f662d0b916 service nova] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c051ecc-c5a1-438a-ba2e-3727e44b699c req-af88c757-b809-4977-8511-91f662d0b916 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c051ecc-c5a1-438a-ba2e-3727e44b699c req-af88c757-b809-4977-8511-91f662d0b916 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c051ecc-c5a1-438a-ba2e-3727e44b699c req-af88c757-b809-4977-8511-91f662d0b916 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] No waiting events found dispatching network-vif-unplugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c051ecc-c5a1-438a-ba2e-3727e44b699c req-af88c757-b809-4977-8511-91f662d0b916 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-vif-unplugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.compute.manager [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Detaching volume f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Instance destroyed successfully.
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.objects.instance [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lazy-loading 'resources' on Instance uuid bb481848-5207-4f0b-b56e-8a48bde425f8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.virt.block_device [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Attempting to driver detach volume f999fdad-7ef1-43cf-9b3a-b6f710ab6efd from mountpoint /dev/vdb
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2145925525',display_name='tempest-VolumesAdminNegativeTest-server-2145925525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2145925525',id=15,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+zViIsxWnnpzbSaGsWjReo8dFD6pMuBgCLBh94roUbkmvl6oNcmWlcWfFijchjK/DxMvX6xlyNusZR4a/Zjk65rYsL+qxVsqrCaoZH4Q0q0f2MrKeQUO+dAr8hVDNjBw==',key_name='tempest-keypair-877285507',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:09:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='826e2b5db9464d15aa10f4f889e9d320',ramdisk_id='',reservation_id='r-vd0p0t9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1041878911',owner_user_name='tempest-VolumesAdminNegativeTest-1041878911-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='866048ee57714ee7aae7be2a57102b0a',uuid=bb481848-5207-4f0b-b56e-8a48bde425f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converting VIF {"id": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "address": "fa:16:3e:cd:9d:59", "network": {"id": "76a95432-998a-492d-af9c-90facf97a345", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1512764145-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "826e2b5db9464d15aa10f4f889e9d320", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28474d81-f7", "ovs_interfaceid": "28474d81-f7a1-4202-a5c1-d6a169cf3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG os_vif [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28474d81-f7, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bccac30f-d29b-4f13-bc59-033f1f84a0c2) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:17:43 user nova-compute[75438]: INFO os_vif [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9d:59,bridge_name='br-int',has_traffic_filtering=True,id=28474d81-f7a1-4202-a5c1-d6a169cf3675,network=Network(76a95432-998a-492d-af9c-90facf97a345),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28474d81-f7')
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Deleting instance files /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8_del
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Deletion of /opt/stack/data/nova/instances/bb481848-5207-4f0b-b56e-8a48bde425f8_del complete
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Attempting to detach device vdb from instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:17:43 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:17:43 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:17:43 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:17:43 user nova-compute[75438]:   <serial>f999fdad-7ef1-43cf-9b3a-b6f710ab6efd</serial>
Nov 09 02:17:43 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:17:43 user nova-compute[75438]: </disk>
Nov 09 02:17:43 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully detached device vdb from instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d from the persistent domain config.
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:17:43 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:17:43 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:17:43 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:17:43 user nova-compute[75438]:   <serial>f999fdad-7ef1-43cf-9b3a-b6f710ab6efd</serial>
Nov 09 02:17:43 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:17:43 user nova-compute[75438]: </disk>
Nov 09 02:17:43 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:17:43 user nova-compute[75438]: INFO nova.compute.manager [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 09 02:17:43 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:17:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:44 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Took 0.97 seconds to deallocate network for instance.
Nov 09 02:17:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-e0835b1c-fe92-4c04-9abf-16d81849f0ec req-003ecd57-6d8d-423c-84dc-a60ecb0e60de service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-vif-deleted-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-e071b12d-0481-4193-a522-404e5d01742a req-61894083-194f-40d9-b4f3-9d0bec77d590 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received event network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e071b12d-0481-4193-a522-404e5d01742a req-61894083-194f-40d9-b4f3-9d0bec77d590 service nova] Acquiring lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e071b12d-0481-4193-a522-404e5d01742a req-61894083-194f-40d9-b4f3-9d0bec77d590 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e071b12d-0481-4193-a522-404e5d01742a req-61894083-194f-40d9-b4f3-9d0bec77d590 service nova] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-e071b12d-0481-4193-a522-404e5d01742a req-61894083-194f-40d9-b4f3-9d0bec77d590 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] No waiting events found dispatching network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:44 user nova-compute[75438]: WARNING nova.compute.manager [req-e071b12d-0481-4193-a522-404e5d01742a req-61894083-194f-40d9-b4f3-9d0bec77d590 service nova] [instance: bb481848-5207-4f0b-b56e-8a48bde425f8] Received unexpected event network-vif-plugged-28474d81-f7a1-4202-a5c1-d6a169cf3675 for instance with vm_state deleted and task_state None.
Nov 09 02:17:44 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Deleted allocations for instance bb481848-5207-4f0b-b56e-8a48bde425f8
Nov 09 02:17:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98f29f95-c8c7-43a4-8fb5-16ece35d2902 tempest-VolumesAdminNegativeTest-1041878911 tempest-VolumesAdminNegativeTest-1041878911-project-member] Lock "bb481848-5207-4f0b-b56e-8a48bde425f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.807s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:50 user nova-compute[75438]: INFO nova.compute.manager [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Terminating instance
Nov 09 02:17:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-a0eefd14-b8dc-4a7d-80d9-569ce473ece6 req-db65a2e8-fc4a-4edc-91d7-4c1dbb1e9cb2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a0eefd14-b8dc-4a7d-80d9-569ce473ece6 req-db65a2e8-fc4a-4edc-91d7-4c1dbb1e9cb2 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a0eefd14-b8dc-4a7d-80d9-569ce473ece6 req-db65a2e8-fc4a-4edc-91d7-4c1dbb1e9cb2 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a0eefd14-b8dc-4a7d-80d9-569ce473ece6 req-db65a2e8-fc4a-4edc-91d7-4c1dbb1e9cb2 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-a0eefd14-b8dc-4a7d-80d9-569ce473ece6 req-db65a2e8-fc4a-4edc-91d7-4c1dbb1e9cb2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-a0eefd14-b8dc-4a7d-80d9-569ce473ece6 req-db65a2e8-fc4a-4edc-91d7-4c1dbb1e9cb2 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-unplugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Instance destroyed successfully.
Nov 09 02:17:51 user nova-compute[75438]: DEBUG nova.objects.instance [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lazy-loading 'resources' on Instance uuid f2c26e99-e089-49f5-9499-6bf035067512 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1933050020',display_name='tempest-ServerStableDeviceRescueTest-server-1933050020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1933050020',id=14,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKDpuWXe8laBaRb9YE1a4T307OlX9DrMSCdp2D+FiV3QrJsddtQiEFNfKYtruYEV/Te6PBx6sTuKx1fNq7XM5ic/fY3vZT/Ur/1hc/vA6eRDgpCFt7xwG0WlMZpFLqUvA==',key_name='tempest-keypair-1023383383',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e41745ea4d9482b8bf124615afcf332',ramdisk_id='',reservation_id='r-ar1gm8na',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1045361722',owner_user_name='tempest-ServerStableDeviceRescueTest-1045361722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:16:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d603c6cb567c414a9c1fef7259b0f124',uuid=f2c26e99-e089-49f5-9499-6bf035067512,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converting VIF {"id": "3ab12034-c674-490a-be6d-db79cecc5b53", "address": "fa:16:3e:7d:5e:ef", "network": {"id": "dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-739780721-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e41745ea4d9482b8bf124615afcf332", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ab12034-c6", "ovs_interfaceid": "3ab12034-c674-490a-be6d-db79cecc5b53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG os_vif [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ab12034-c6, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f44324a-5303-4646-afd6-5ec6485fc219) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:51 user nova-compute[75438]: INFO os_vif [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:5e:ef,bridge_name='br-int',has_traffic_filtering=True,id=3ab12034-c674-490a-be6d-db79cecc5b53,network=Network(dc6d09d0-6e00-4dbb-ab12-d4abf5be01a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ab12034-c6')
Nov 09 02:17:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Deleting instance files /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512_del
Nov 09 02:17:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Deletion of /opt/stack/data/nova/instances/f2c26e99-e089-49f5-9499-6bf035067512_del complete
Nov 09 02:17:51 user nova-compute[75438]: INFO nova.compute.manager [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 02:17:51 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:17:51 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:17:52 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Took 0.95 seconds to deallocate network for instance.
Nov 09 02:17:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-61f2cef3-2145-4b01-8f3b-35e3bbc52f7e req-8cf298b1-073f-47eb-ab70-371510e84a2a service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-deleted-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-e1fe4456-a538-499b-9b44-8a7d526c8e82 req-ba18f056-b3e6-4e8f-9c11-e59ed7c81660 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e1fe4456-a538-499b-9b44-8a7d526c8e82 req-ba18f056-b3e6-4e8f-9c11-e59ed7c81660 service nova] Acquiring lock "f2c26e99-e089-49f5-9499-6bf035067512-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e1fe4456-a538-499b-9b44-8a7d526c8e82 req-ba18f056-b3e6-4e8f-9c11-e59ed7c81660 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e1fe4456-a538-499b-9b44-8a7d526c8e82 req-ba18f056-b3e6-4e8f-9c11-e59ed7c81660 service nova] Lock "f2c26e99-e089-49f5-9499-6bf035067512-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-e1fe4456-a538-499b-9b44-8a7d526c8e82 req-ba18f056-b3e6-4e8f-9c11-e59ed7c81660 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] No waiting events found dispatching network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:17:52 user nova-compute[75438]: WARNING nova.compute.manager [req-e1fe4456-a538-499b-9b44-8a7d526c8e82 req-ba18f056-b3e6-4e8f-9c11-e59ed7c81660 service nova] [instance: f2c26e99-e089-49f5-9499-6bf035067512] Received unexpected event network-vif-plugged-3ab12034-c674-490a-be6d-db79cecc5b53 for instance with vm_state deleted and task_state None.
Nov 09 02:17:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:53 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Deleted allocations for instance f2c26e99-e089-49f5-9499-6bf035067512
Nov 09 02:17:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2f901b87-cc81-4a15-a03f-91491dc4b4d3 tempest-ServerStableDeviceRescueTest-1045361722 tempest-ServerStableDeviceRescueTest-1045361722-project-member] Lock "f2c26e99-e089-49f5-9499-6bf035067512" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.656s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:17:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:17:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:17:56 user nova-compute[75438]: INFO nova.compute.manager [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] instance snapshotting
Nov 09 02:17:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Beginning live snapshot process
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgr02jcqh/4ef7dfc8d50947d0b01252178f37c2cd.delta 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgr02jcqh/4ef7dfc8d50947d0b01252178f37c2cd.delta 1073741824" returned: 0 in 0.053s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 02:17:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKzocwus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:17:58 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:17:58 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:17:58 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0a0e6e-8603-4753-8032-fc45df947eeb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:17:58 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb89c8ed-a561-4a9d-9715-5b99a212a553]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e] added
Nov 09 02:17:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee079b6-312c-477d-9889-35ea4ae543f8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9a569-7556-42dc-bae9-01d50b8f0d66]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKzocwus {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKzocwus" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32cb222-e026-4cfd-98f6-c2f857f04f4f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKzocwus'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce1f83f-1f44-4d62-ab6a-f6c308614e51]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c5d46c-8848-406e-ad78-9484847d1ab7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:17:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:17:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[df88ddfc-f27c-4e30-85c9-3d015a41adcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260]
Nov 09 02:17:58 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260] successful.
Nov 09 02:17:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad93519f-fa0a-4c0b-9bf1-142c3860b29b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a83e2-52a4-4d93-a59a-28afe77bcc57]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:17:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:17:58 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:17:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a2cf9f-3d02-46d5-a174-e36e26a9ca48]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKzocwus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:17:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] COPY block job progress, current cursor: 12713984 final cursor: 75563008 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26630626234623361', 'path': '/dev/sde'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630626234623361', 'path': '/dev/sde'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.objects.instance [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:17:59 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:17:59 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:17:59 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:17:59 user nova-compute[75438]:   <serial>abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e</serial>
Nov 09 02:17:59 user nova-compute[75438]: </disk>
Nov 09 02:17:59 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:17:59 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgr02jcqh/4ef7dfc8d50947d0b01252178f37c2cd.delta /opt/stack/data/nova/instances/snapshots/tmpgr02jcqh/4ef7dfc8d50947d0b01252178f37c2cd {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:17:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No VIF found with MAC fa:16:3e:8d:78:22, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:18:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-301cf611-9fd2-473a-bbdd-6be925798b4b tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.935s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgr02jcqh/4ef7dfc8d50947d0b01252178f37c2cd.delta /opt/stack/data/nova/instances/snapshots/tmpgr02jcqh/4ef7dfc8d50947d0b01252178f37c2cd" returned: 0 in 0.884s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:00 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Snapshot extracted, beginning image upload
Nov 09 02:18:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:03 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Snapshot image upload complete
Nov 09 02:18:03 user nova-compute[75438]: INFO nova.compute.manager [None req-c9ae8afb-061d-4f7b-9e7a-521802f8118a tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Took 6.69 seconds to snapshot the instance on the hypervisor.
Nov 09 02:18:03 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d is timed out.
Nov 09 02:18:03 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully detached device vdb from instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d from the live domain config.
Nov 09 02:18:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSwgIXhi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:18:03 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[770575e9-e746-4df8-8383-11d0c13a0d7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:18:03 user nova-compute[75438]: No targets found.
Nov 09 02:18:03 user nova-compute[75438]: iSNS:
Nov 09 02:18:03 user nova-compute[75438]: No targets found.
Nov 09 02:18:03 user nova-compute[75438]: STATIC:
Nov 09 02:18:03 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:18:03 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:03 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:03 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:18:03 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:03 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:03 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd
Nov 09 02:18:03 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:03 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:03 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:18:03 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:03 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:03 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e
Nov 09 02:18:03 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:03 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:03 user nova-compute[75438]: FIRMWARE:
Nov 09 02:18:03 user nova-compute[75438]: No targets found.
Nov 09 02:18:03 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:18:03 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:18:03 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819b9ef-b989-487e-9eaa-ddbff9ab4ead]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a48f453-fa59-458b-9881-938c70a35d04]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:03 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:03 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:03 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24752560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[821b3102-b97e-4341-b3bc-01e4a6fa92ce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb59672-7333-4b07-afcd-07ae20f6835c]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a378463b-9eda-4afc-920b-0333e7456a9d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba1f5e-6916-4be2-a55c-450d0bbdd5f1]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:18:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3946ba7a-8584-4a00-908c-3bd6e9a31b96]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df01f24-2062-45b6-9b3e-b0ea65a7189b]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260]
Nov 09 02:18:04 user nova-compute[75438]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd, portal: 172.16.0.220,3260] successful.
Nov 09 02:18:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f999fdad-7ef1-43cf-9b3a-b6f710ab6efd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed7d26e-1295-4760-86fb-5d4715b7d7bd]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] <== disconnect_volume: return (329ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:18:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:18:05 user nova-compute[75438]: DEBUG nova.objects.instance [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'flavor' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0cf10a92-b8c9-4d51-a5e0-cdceb9de8b60 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.125s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:18:06 user nova-compute[75438]: INFO nova.compute.claims [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Claim successful on node user
Nov 09 02:18:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG nova.objects.instance [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.090s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'pci_requests' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'numa_topology' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:07 user nova-compute[75438]: INFO nova.compute.manager [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attaching volume f4c4ba64-6e32-4710-8a54-da04efef6aab to /dev/vdc
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:18:07 user nova-compute[75438]: INFO nova.compute.claims [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Claim successful on node user
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:18:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:18:07 user nova-compute[75438]: DEBUG os_brick.utils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f4977b-b798-4585-80a6-60963cfacf09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc1caee-b341-44c1-8419-64d072b6c811]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c1adc4-5fbd-4692-aef6-45cdf5ce9228]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2695762-ac5d-47cb-9266-17b85f407ba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.policy [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '784e9264262a4176839b41cd5d296b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0cb190e1d94289bf11c5544f59f729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:18:07 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b4b142-3846-4ebf-98b3-60d76fced2a5]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG os_brick.utils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating existing volume attachment record: 3a412684-9281-49e4-85e5-759433e1cccd {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:18:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Creating image(s)
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "/opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "/opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "/opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "0ee332a1f415858f156373e5fa33d7ca608dc91b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "0ee332a1f415858f156373e5fa33d7ca608dc91b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Successfully created port: b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG nova.virt.images [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] 8dc58bca-7edb-4bf4-babf-47b5ce05bbe5 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.part /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:18:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.800s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.part /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.converted" returned: 0 in 0.293s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:09 user nova-compute[75438]: INFO nova.network.neutron [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "0ee332a1f415858f156373e5fa33d7ca608dc91b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.844s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "0ee332a1f415858f156373e5fa33d7ca608dc91b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "0ee332a1f415858f156373e5fa33d7ca608dc91b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Successfully updated port: b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquired lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-changed-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Refreshing instance network info cache due to event network-changed-b4a5af82-6853-4d74-98b6-1ee69b313efb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] Acquiring lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b,backing_fmt=raw /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b,backing_fmt=raw /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk 1073741824" returned: 0 in 0.056s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "0ee332a1f415858f156373e5fa33d7ca608dc91b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Ensure instance console log exists: /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updating instance_info_cache with network_info: [{"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Releasing lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Instance network_info: |[{"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] Acquired lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Refreshing network info cache for port b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Start _get_guest_xml network_info=[{"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8004699897398b20424bde38b278f40e',container_format='bare',created_at=2023-11-09T02:17:57Z,direct_url=<?>,disk_format='qcow2',id=8dc58bca-7edb-4bf4-babf-47b5ce05bbe5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-579873498',owner='af0cb190e1d94289bf11c5544f59f729',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T02:18:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '8dc58bca-7edb-4bf4-babf-47b5ce05bbe5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:18:10 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:18:10 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8004699897398b20424bde38b278f40e',container_format='bare',created_at=2023-11-09T02:17:57Z,direct_url=<?>,disk_format='qcow2',id=8dc58bca-7edb-4bf4-babf-47b5ce05bbe5,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-579873498',owner='af0cb190e1d94289bf11c5544f59f729',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T02:18:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255296997',display_name='tempest-TestStampPattern-server-1255296997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255296997',id=28,image_ref='8dc58bca-7edb-4bf4-babf-47b5ce05bbe5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVAyDRMwjffSqEHQgor1GlyDLaiutN3jGdYixpZry7+mEwIRl0guCFtbKn75XhCI7/ZvTNaQO6Y0hO50K1IkCzCXsM8x/dTz4eGhUYnuIbnYN3L7sdNfCDhQ16Ix2+1ug==',key_name='tempest-TestStampPattern-1748362078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0cb190e1d94289bf11c5544f59f729',ramdisk_id='',reservation_id='r-mwnpto56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='350eb030-6104-46bb-9ffe-da6dcb7244ee',image_min_disk='1',image_min_ram='0',image_owner_id='af0cb190e1d94289bf11c5544f59f729',image_owner_project_name='tempest-TestStampPattern-124162614',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-124162614-project-member',image_user_id='784e9264262a4176839b41cd5d296b94',network_allocated='True',owner_project_name='tempest-TestStampPattern-124162614',owner_user_name='tempest-TestStampPattern-124162614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:18:07Z,user_data=None,user_id='784e9264262a4176839b41cd5d296b94',uuid=4de76ce8-194f-43b7-82b0-1a30c349ab50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converting VIF {"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'pci_devices' on Instance uuid 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:18:10 user nova-compute[75438]:   <uuid>4de76ce8-194f-43b7-82b0-1a30c349ab50</uuid>
Nov 09 02:18:10 user nova-compute[75438]:   <name>instance-0000001c</name>
Nov 09 02:18:10 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:18:10 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:18:10 user nova-compute[75438]:   <metadata>
Nov 09 02:18:10 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:18:10 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:18:10 user nova-compute[75438]:       <nova:name>tempest-TestStampPattern-server-1255296997</nova:name>
Nov 09 02:18:10 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:18:10</nova:creationTime>
Nov 09 02:18:10 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:18:10 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:18:10 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:18:10 user nova-compute[75438]:       <nova:owner>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:user uuid="784e9264262a4176839b41cd5d296b94">tempest-TestStampPattern-124162614-project-member</nova:user>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:project uuid="af0cb190e1d94289bf11c5544f59f729">tempest-TestStampPattern-124162614</nova:project>
Nov 09 02:18:10 user nova-compute[75438]:       </nova:owner>
Nov 09 02:18:10 user nova-compute[75438]:       <nova:root type="image" uuid="8dc58bca-7edb-4bf4-babf-47b5ce05bbe5"/>
Nov 09 02:18:10 user nova-compute[75438]:       <nova:ports>
Nov 09 02:18:10 user nova-compute[75438]:         <nova:port uuid="b4a5af82-6853-4d74-98b6-1ee69b313efb">
Nov 09 02:18:10 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:18:10 user nova-compute[75438]:         </nova:port>
Nov 09 02:18:10 user nova-compute[75438]:       </nova:ports>
Nov 09 02:18:10 user nova-compute[75438]:     </nova:instance>
Nov 09 02:18:10 user nova-compute[75438]:   </metadata>
Nov 09 02:18:10 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:18:10 user nova-compute[75438]:     <system>
Nov 09 02:18:10 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:18:10 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:18:10 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:18:10 user nova-compute[75438]:       <entry name="serial">4de76ce8-194f-43b7-82b0-1a30c349ab50</entry>
Nov 09 02:18:10 user nova-compute[75438]:       <entry name="uuid">4de76ce8-194f-43b7-82b0-1a30c349ab50</entry>
Nov 09 02:18:10 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:18:10 user nova-compute[75438]:     </system>
Nov 09 02:18:10 user nova-compute[75438]:   </sysinfo>
Nov 09 02:18:10 user nova-compute[75438]:   <os>
Nov 09 02:18:10 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:18:10 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:18:10 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:18:10 user nova-compute[75438]:   </os>
Nov 09 02:18:10 user nova-compute[75438]:   <features>
Nov 09 02:18:10 user nova-compute[75438]:     <acpi/>
Nov 09 02:18:10 user nova-compute[75438]:     <apic/>
Nov 09 02:18:10 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:18:10 user nova-compute[75438]:   </features>
Nov 09 02:18:10 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:18:10 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:18:10 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:18:10 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:18:10 user nova-compute[75438]:   </clock>
Nov 09 02:18:10 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:18:10 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:18:10 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:18:10 user nova-compute[75438]:   </cpu>
Nov 09 02:18:10 user nova-compute[75438]:   <devices>
Nov 09 02:18:10 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:18:10 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:18:10 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk"/>
Nov 09 02:18:10 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:18:10 user nova-compute[75438]:     </disk>
Nov 09 02:18:10 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:18:10 user nova-compute[75438]:       <mac address="fa:16:3e:d2:30:e5"/>
Nov 09 02:18:10 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:18:10 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:18:10 user nova-compute[75438]:       <target dev="tapb4a5af82-68"/>
Nov 09 02:18:10 user nova-compute[75438]:     </interface>
Nov 09 02:18:10 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:18:10 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/console.log" append="off"/>
Nov 09 02:18:10 user nova-compute[75438]:     </serial>
Nov 09 02:18:10 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:18:10 user nova-compute[75438]:     <video>
Nov 09 02:18:10 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:18:10 user nova-compute[75438]:     </video>
Nov 09 02:18:10 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:18:10 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:18:10 user nova-compute[75438]:     </rng>
Nov 09 02:18:10 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:18:10 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:18:10 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:18:10 user nova-compute[75438]:     </memballoon>
Nov 09 02:18:10 user nova-compute[75438]:   </devices>
Nov 09 02:18:10 user nova-compute[75438]: </domain>
Nov 09 02:18:10 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255296997',display_name='tempest-TestStampPattern-server-1255296997',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255296997',id=28,image_ref='8dc58bca-7edb-4bf4-babf-47b5ce05bbe5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVAyDRMwjffSqEHQgor1GlyDLaiutN3jGdYixpZry7+mEwIRl0guCFtbKn75XhCI7/ZvTNaQO6Y0hO50K1IkCzCXsM8x/dTz4eGhUYnuIbnYN3L7sdNfCDhQ16Ix2+1ug==',key_name='tempest-TestStampPattern-1748362078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af0cb190e1d94289bf11c5544f59f729',ramdisk_id='',reservation_id='r-mwnpto56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='350eb030-6104-46bb-9ffe-da6dcb7244ee',image_min_disk='1',image_min_ram='0',image_owner_id='af0cb190e1d94289bf11c5544f59f729',image_owner_project_name='tempest-TestStampPattern-124162614',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-124162614-project-member',image_user_id='784e9264262a4176839b41cd5d296b94',network_allocated='True',owner_project_name='tempest-TestStampPattern-124162614',owner_user_name='tempest-TestStampPattern-124162614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:18:07Z,user_data=None,user_id='784e9264262a4176839b41cd5d296b94',uuid=4de76ce8-194f-43b7-82b0-1a30c349ab50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converting VIF {"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_vif [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30bbbdc1-a965-55c8-b137-97307ef0ca84', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4a5af82-68, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4a5af82-68, col_values=(('qos', UUID('5e34fba3-8226-45af-907f-a3518e9112e3')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4a5af82-68, col_values=(('external_ids', {'iface-id': 'b4a5af82-6853-4d74-98b6-1ee69b313efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:30:e5', 'vm-uuid': '4de76ce8-194f-43b7-82b0-1a30c349ab50'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:10 user nova-compute[75438]: INFO os_vif [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68')
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing instance network info cache due to event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No VIF found with MAC fa:16:3e:d2:30:e5, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:18:10 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Creating image(s)
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Ensure instance console log exists: /opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Start _get_guest_xml network_info=[{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'fffd5b72-eccd-4978-958e-018024a40aa4', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '896758d5-8945-4fb7-a90f-a86084c7fd3a', 'attached_at': '', 'detached_at': '', 'volume_id': '09015b7e-a26a-4bb8-afc1-972768386128', 'serial': '09015b7e-a26a-4bb8-afc1-972768386128'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:18:10 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:18:10 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.objects.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Object Instance<896758d5-8945-4fb7-a90f-a86084c7fd3a> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:18:10 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:10 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:10 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updated VIF entry in instance network info cache for port b4a5af82-6853-4d74-98b6-1ee69b313efb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updating instance_info_cache with network_info: [{"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e886abd6-95dc-4aec-ac56-966b420d378a req-54786055-4dac-4817-a62a-f9d29e6b3f3c service nova] Releasing lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d2e3ab-8653-43cb-8501-27231750d26c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:18:10 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d05fa-d730-4c6f-9a17-6ffdb33a3b86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128] added
Nov 09 02:18:10 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eafadd-2205-4d25-9aa4-320144a3c3d8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1651e51b-cbec-4e91-9d39-01f185125461]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnaMHekt {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hnaMHekt" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4667c256-beea-4347-8fd4-f8baf9acca2d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hnaMHekt'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a31a21-e099-4d01-85c8-602040a4bd09]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34ab24-77ef-4b90-9b22-b643034fab10]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:10 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:10 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:10 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:10 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:10 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:10 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:10 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:10 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b32fe73-f528-41d0-a79d-d1a1193dfaad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]
Nov 09 02:18:11 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.
Nov 09 02:18:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04a9a43-809e-4cc3-aee2-13bbffd78628]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e52129d-8bb9-4435-91ee-678e43ecb29d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:11 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a9953c-3932-4717-a401-9e5a73977aeb]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updated VIF entry in instance network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-53b5a634-209b-4fc8-986f-976d44d48847 req-c2244e51-2961-4495-b366-05a2cc3091dc service nova] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-aa486aae-b877-48af-b98b-48c1ebcfcd6a req-efc40a78-4ed6-47a6-9c1b-8c97b3016c04 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-aa486aae-b877-48af-b98b-48c1ebcfcd6a req-efc40a78-4ed6-47a6-9c1b-8c97b3016c04 service nova] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-aa486aae-b877-48af-b98b-48c1ebcfcd6a req-efc40a78-4ed6-47a6-9c1b-8c97b3016c04 service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-aa486aae-b877-48af-b98b-48c1ebcfcd6a req-efc40a78-4ed6-47a6-9c1b-8c97b3016c04 service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-aa486aae-b877-48af-b98b-48c1ebcfcd6a req-efc40a78-4ed6-47a6-9c1b-8c97b3016c04 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] No waiting events found dispatching network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:12 user nova-compute[75438]: WARNING nova.compute.manager [req-aa486aae-b877-48af-b98b-48c1ebcfcd6a req-efc40a78-4ed6-47a6-9c1b-8c97b3016c04 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received unexpected event network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb for instance with vm_state building and task_state spawning.
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26134346234636630', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134346234636630', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-808013591',display_name='tempest-TestShelveInstance-server-808013591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-808013591',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1475462915',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:13:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='56c37c1382f74f9689baf00837b8bfa8',ramdisk_id='',reservation_id='r-iysa0vvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-838005507',owner_user_name='tempest-TestShelveInstance-838005507-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:17:07Z,user_data=None,user_id='2959b8b821e9406480159ced072408e6',uuid=896758d5-8945-4fb7-a90f-a86084c7fd3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converting VIF {"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'pci_devices' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.objects.base [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Object Instance<896758d5-8945-4fb7-a90f-a86084c7fd3a> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:18:12 user nova-compute[75438]:   <uuid>896758d5-8945-4fb7-a90f-a86084c7fd3a</uuid>
Nov 09 02:18:12 user nova-compute[75438]:   <name>instance-00000015</name>
Nov 09 02:18:12 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:18:12 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:18:12 user nova-compute[75438]:   <metadata>
Nov 09 02:18:12 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:18:12 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:18:12 user nova-compute[75438]:       <nova:name>tempest-TestShelveInstance-server-808013591</nova:name>
Nov 09 02:18:12 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:18:10</nova:creationTime>
Nov 09 02:18:12 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:18:12 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:18:12 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:18:12 user nova-compute[75438]:       <nova:owner>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:user uuid="2959b8b821e9406480159ced072408e6">tempest-TestShelveInstance-838005507-project-member</nova:user>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:project uuid="56c37c1382f74f9689baf00837b8bfa8">tempest-TestShelveInstance-838005507</nova:project>
Nov 09 02:18:12 user nova-compute[75438]:       </nova:owner>
Nov 09 02:18:12 user nova-compute[75438]:       <nova:ports>
Nov 09 02:18:12 user nova-compute[75438]:         <nova:port uuid="0dcd4f57-485c-406e-9e6c-7f9dfb5865d8">
Nov 09 02:18:12 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:18:12 user nova-compute[75438]:         </nova:port>
Nov 09 02:18:12 user nova-compute[75438]:       </nova:ports>
Nov 09 02:18:12 user nova-compute[75438]:     </nova:instance>
Nov 09 02:18:12 user nova-compute[75438]:   </metadata>
Nov 09 02:18:12 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:18:12 user nova-compute[75438]:     <system>
Nov 09 02:18:12 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:18:12 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:18:12 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:18:12 user nova-compute[75438]:       <entry name="serial">896758d5-8945-4fb7-a90f-a86084c7fd3a</entry>
Nov 09 02:18:12 user nova-compute[75438]:       <entry name="uuid">896758d5-8945-4fb7-a90f-a86084c7fd3a</entry>
Nov 09 02:18:12 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:18:12 user nova-compute[75438]:     </system>
Nov 09 02:18:12 user nova-compute[75438]:   </sysinfo>
Nov 09 02:18:12 user nova-compute[75438]:   <os>
Nov 09 02:18:12 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:18:12 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:18:12 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:18:12 user nova-compute[75438]:   </os>
Nov 09 02:18:12 user nova-compute[75438]:   <features>
Nov 09 02:18:12 user nova-compute[75438]:     <acpi/>
Nov 09 02:18:12 user nova-compute[75438]:     <apic/>
Nov 09 02:18:12 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:18:12 user nova-compute[75438]:   </features>
Nov 09 02:18:12 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:18:12 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:18:12 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:18:12 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:18:12 user nova-compute[75438]:   </clock>
Nov 09 02:18:12 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:18:12 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:18:12 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:18:12 user nova-compute[75438]:   </cpu>
Nov 09 02:18:12 user nova-compute[75438]:   <devices>
Nov 09 02:18:12 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:18:12 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:18:12 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:18:12 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:18:12 user nova-compute[75438]:       <serial>09015b7e-a26a-4bb8-afc1-972768386128</serial>
Nov 09 02:18:12 user nova-compute[75438]:     </disk>
Nov 09 02:18:12 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:18:12 user nova-compute[75438]:       <mac address="fa:16:3e:21:14:79"/>
Nov 09 02:18:12 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:18:12 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:18:12 user nova-compute[75438]:       <target dev="tap0dcd4f57-48"/>
Nov 09 02:18:12 user nova-compute[75438]:     </interface>
Nov 09 02:18:12 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:18:12 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a/console.log" append="off"/>
Nov 09 02:18:12 user nova-compute[75438]:     </serial>
Nov 09 02:18:12 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:18:12 user nova-compute[75438]:     <video>
Nov 09 02:18:12 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:18:12 user nova-compute[75438]:     </video>
Nov 09 02:18:12 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:18:12 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:18:12 user nova-compute[75438]:     </rng>
Nov 09 02:18:12 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:18:12 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:18:12 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:18:12 user nova-compute[75438]:     </memballoon>
Nov 09 02:18:12 user nova-compute[75438]:   </devices>
Nov 09 02:18:12 user nova-compute[75438]: </domain>
Nov 09 02:18:12 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-808013591',display_name='tempest-TestShelveInstance-server-808013591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-808013591',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1475462915',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:13:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='56c37c1382f74f9689baf00837b8bfa8',ramdisk_id='',reservation_id='r-iysa0vvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-838005507',owner_user_name='tempest-TestShelveInstance-838005507-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:17:07Z,user_data=None,user_id='2959b8b821e9406480159ced072408e6',uuid=896758d5-8945-4fb7-a90f-a86084c7fd3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converting VIF {"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG os_vif [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87be94cc-1fc9-5529-a9a7-264a6cbb96cb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dcd4f57-48, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dcd4f57-48, col_values=(('qos', UUID('616d217c-c59f-48d4-ab04-fe6ece33518d')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dcd4f57-48, col_values=(('external_ids', {'iface-id': '0dcd4f57-485c-406e-9e6c-7f9dfb5865d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:14:79', 'vm-uuid': '896758d5-8945-4fb7-a90f-a86084c7fd3a'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:12 user nova-compute[75438]: INFO os_vif [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48')
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:18:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] No VIF found with MAC fa:16:3e:21:14:79, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:18:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] No waiting events found dispatching network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:14 user nova-compute[75438]: WARNING nova.compute.manager [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received unexpected event network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb for instance with vm_state building and task_state spawning.
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:14 user nova-compute[75438]: WARNING nova.compute.manager [req-eb902801-b1c7-4e8a-81ff-ea717736ca16 req-c63d4726-0006-438e-9a6a-16494532fa5e service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:18:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Instance spawned successfully.
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:14 user nova-compute[75438]: INFO nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 09 02:18:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:18:14 user nova-compute[75438]: INFO nova.compute.manager [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Took 8.30 seconds to build instance.
Nov 09 02:18:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ceccd-fa45-4b7a-9ae9-213c0ef342c6 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.578s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:18:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance spawned successfully.
Nov 09 02:18:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-43e6e559-616d-4ea3-aa11-c32e4d687bba req-84f57231-f8ad-4712-b402-f9aa89b6fd59 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-43e6e559-616d-4ea3-aa11-c32e4d687bba req-84f57231-f8ad-4712-b402-f9aa89b6fd59 service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-43e6e559-616d-4ea3-aa11-c32e4d687bba req-84f57231-f8ad-4712-b402-f9aa89b6fd59 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-43e6e559-616d-4ea3-aa11-c32e4d687bba req-84f57231-f8ad-4712-b402-f9aa89b6fd59 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-43e6e559-616d-4ea3-aa11-c32e4d687bba req-84f57231-f8ad-4712-b402-f9aa89b6fd59 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:16 user nova-compute[75438]: WARNING nova.compute.manager [req-43e6e559-616d-4ea3-aa11-c32e4d687bba req-84f57231-f8ad-4712-b402-f9aa89b6fd59 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 02:18:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d3f62547-b07c-46ca-a00c-7ea24469d8cf tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 68.965s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:27 user nova-compute[75438]: INFO nova.compute.manager [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Unrescuing
Nov 09 02:18:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'flavor' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-eefb8a5d-be07-408f-b348-3079eb30a59d req-9574e335-f75c-4a84-be65-ba54046fde91 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eefb8a5d-be07-408f-b348-3079eb30a59d req-9574e335-f75c-4a84-be65-ba54046fde91 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eefb8a5d-be07-408f-b348-3079eb30a59d req-9574e335-f75c-4a84-be65-ba54046fde91 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eefb8a5d-be07-408f-b348-3079eb30a59d req-9574e335-f75c-4a84-be65-ba54046fde91 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-eefb8a5d-be07-408f-b348-3079eb30a59d req-9574e335-f75c-4a84-be65-ba54046fde91 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:27 user nova-compute[75438]: WARNING nova.compute.manager [req-eefb8a5d-be07-408f-b348-3079eb30a59d req-9574e335-f75c-4a84-be65-ba54046fde91 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:18:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance destroyed successfully.
Nov 09 02:18:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:28 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:18:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:30 user nova-compute[75438]: WARNING nova.compute.manager [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:30 user nova-compute[75438]: WARNING nova.compute.manager [req-d192c726-962b-4f7d-bb5a-3ef6924a9cdb req-46362b45-f854-4b08-81ef-03a9a99bd299 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:30 user nova-compute[75438]: INFO nova.compute.manager [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Detaching volume bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:30 user nova-compute[75438]: INFO nova.virt.block_device [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Attempting to driver detach volume bc1e01dc-86c0-473d-a4a5-d1509479d43a from mountpoint /dev/vdb
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Attempting to detach device vdb from instance a3b47518-63f5-4a38-834d-5627bec3892d from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:18:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:18:30 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:18:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:18:30 user nova-compute[75438]:   <serial>bc1e01dc-86c0-473d-a4a5-d1509479d43a</serial>
Nov 09 02:18:30 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:18:30 user nova-compute[75438]: </disk>
Nov 09 02:18:30 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:18:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully detached device vdb from instance a3b47518-63f5-4a38-834d-5627bec3892d from the persistent domain config.
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3b47518-63f5-4a38-834d-5627bec3892d from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:18:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:18:30 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:18:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:18:30 user nova-compute[75438]:   <serial>bc1e01dc-86c0-473d-a4a5-d1509479d43a</serial>
Nov 09 02:18:30 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:18:30 user nova-compute[75438]: </disk>
Nov 09 02:18:30 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11cc0c9a-39c8-4a0d-9514-629deeed5a54 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-e2f4ae60-e45b-4fc7-ad7e-64024df8eb2e req-16eb1b65-c7f4-4086-b570-6d15283dfeb1 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e2f4ae60-e45b-4fc7-ad7e-64024df8eb2e req-16eb1b65-c7f4-4086-b570-6d15283dfeb1 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e2f4ae60-e45b-4fc7-ad7e-64024df8eb2e req-16eb1b65-c7f4-4086-b570-6d15283dfeb1 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e2f4ae60-e45b-4fc7-ad7e-64024df8eb2e req-16eb1b65-c7f4-4086-b570-6d15283dfeb1 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-e2f4ae60-e45b-4fc7-ad7e-64024df8eb2e req-16eb1b65-c7f4-4086-b570-6d15283dfeb1 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:32 user nova-compute[75438]: WARNING nova.compute.manager [req-e2f4ae60-e45b-4fc7-ad7e-64024df8eb2e req-16eb1b65-c7f4-4086-b570-6d15283dfeb1 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state None.
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:33 user nova-compute[75438]: INFO nova.compute.manager [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Terminating instance
Nov 09 02:18:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-8fa97e96-7626-4285-8006-fcb67a684b77 req-6342ebf1-695e-43c7-b703-480576d9168a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8fa97e96-7626-4285-8006-fcb67a684b77 req-6342ebf1-695e-43c7-b703-480576d9168a service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8fa97e96-7626-4285-8006-fcb67a684b77 req-6342ebf1-695e-43c7-b703-480576d9168a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8fa97e96-7626-4285-8006-fcb67a684b77 req-6342ebf1-695e-43c7-b703-480576d9168a service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-8fa97e96-7626-4285-8006-fcb67a684b77 req-6342ebf1-695e-43c7-b703-480576d9168a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-8fa97e96-7626-4285-8006-fcb67a684b77 req-6342ebf1-695e-43c7-b703-480576d9168a service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-unplugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:18:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Instance destroyed successfully.
Nov 09 02:18:34 user nova-compute[75438]: DEBUG nova.objects.instance [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'resources' on Instance uuid 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:11:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2017582046',display_name='tempest-ServerRescueNegativeTestJSON-server-2017582046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2017582046',id=18,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1p/3B+c15jCLdpAkQLerArcyvJcCFaICTi+O31TuA5oQKNx0JzlTlHURY+pMWgl/LUvKYUWiZueWxJGQ7iMmyKEKvZxPV5oIJyvUy79GVwlsEBGGVkupiWcyov7Dv4ng==',key_name='tempest-keypair-544213512',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-jtr2iw2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:15:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "address": "fa:16:3e:94:2b:ac", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape62b5ee2-b0", "ovs_interfaceid": "e62b5ee2-b006-48b2-a038-94869d96fc8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG os_vif [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape62b5ee2-b0, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9be4e7af-ff24-4502-aeb4-a6374361d97a) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:34 user nova-compute[75438]: INFO os_vif [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:2b:ac,bridge_name='br-int',has_traffic_filtering=True,id=e62b5ee2-b006-48b2-a038-94869d96fc8a,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape62b5ee2-b0')
Nov 09 02:18:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Deleting instance files /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d_del
Nov 09 02:18:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Deletion of /opt/stack/data/nova/instances/7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d_del complete
Nov 09 02:18:34 user nova-compute[75438]: INFO nova.compute.manager [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRnTvrsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:18:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:35 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:18:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7010MB free_disk=24.7872314453125GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61fc84-f23d-4aec-b478-6bbcd073fb9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:18:35 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Took 0.97 seconds to deallocate network for instance.
Nov 09 02:18:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-58df37b9-4ba5-48b7-80cf-150ff222bc28 req-18476682-6d10-4c18-8bc3-05182063a1d7 service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-deleted-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab7a20-6062-46f5-a053-59844c37a551]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab] added
Nov 09 02:18:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1297e16-0080-4182-886a-8964e3621f09]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[da58f453-3104-4358-ba9f-76dc8e990666]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRnTvrsB {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DRnTvrsB" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d9f249-3041-42a4-90ca-163e1123ba66]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DRnTvrsB'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe39a82-f834-4e96-80e7-2f4acafaa05a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9736c09-a550-4716-94af-ba3064b853a9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0260b183-ba1a-44f8-bffb-d675684c4f83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260]
Nov 09 02:18:35 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260] successful.
Nov 09 02:18:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec2d5e4-f9dd-4127-bc0e-b57f4f7c8ed1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a3b47518-63f5-4a38-834d-5627bec3892d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 896758d5-8945-4fb7-a90f-a86084c7fd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adb65e8-0adc-4ca0-8db6-ac1090adc923]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:18:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:35 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:18:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d78f5e8-a29d-442d-9069-c8471e256de8]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRnTvrsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:18:35 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-5303028b-0bfa-4bc1-9d8c-e54f554d0047 req-e6a11696-f3fa-40aa-b244-33ac0c9a6f9c service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5303028b-0bfa-4bc1-9d8c-e54f554d0047 req-e6a11696-f3fa-40aa-b244-33ac0c9a6f9c service nova] Acquiring lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5303028b-0bfa-4bc1-9d8c-e54f554d0047 req-e6a11696-f3fa-40aa-b244-33ac0c9a6f9c service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5303028b-0bfa-4bc1-9d8c-e54f554d0047 req-e6a11696-f3fa-40aa-b244-33ac0c9a6f9c service nova] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-5303028b-0bfa-4bc1-9d8c-e54f554d0047 req-e6a11696-f3fa-40aa-b244-33ac0c9a6f9c service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] No waiting events found dispatching network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:18:36 user nova-compute[75438]: WARNING nova.compute.manager [req-5303028b-0bfa-4bc1-9d8c-e54f554d0047 req-e6a11696-f3fa-40aa-b244-33ac0c9a6f9c service nova] [instance: 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d] Received unexpected event network-vif-plugged-e62b5ee2-b006-48b2-a038-94869d96fc8a for instance with vm_state deleted and task_state None.
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.946s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.833s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26331373664363935', 'path': '/dev/sdg'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331373664363935', 'path': '/dev/sdg'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.objects.instance [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.457s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:18:36 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:18:36 user nova-compute[75438]:   <source dev="/dev/sdg"/>
Nov 09 02:18:36 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:18:36 user nova-compute[75438]:   <serial>f4c4ba64-6e32-4710-8a54-da04efef6aab</serial>
Nov 09 02:18:36 user nova-compute[75438]: </disk>
Nov 09 02:18:36 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:18:37 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Deleted allocations for instance 7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d
Nov 09 02:18:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-85b31cee-ca95-4dce-a52b-fbccd3341fbc tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "7aa7c89b-453e-47b3-bc6f-5d0fd95dff1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:18:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:18:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:18:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] No VIF found with MAC fa:16:3e:8d:78:22, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:18:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-567c3118-9876-4768-a9ac-ea77be4ca1fd tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.432s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:18:38 user nova-compute[75438]: INFO nova.compute.manager [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Detaching volume abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e
Nov 09 02:18:38 user nova-compute[75438]: INFO nova.virt.block_device [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attempting to driver detach volume abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e from mountpoint /dev/vdb
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Attempting to detach device vdb from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:18:38 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:18:38 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:18:38 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:18:38 user nova-compute[75438]:   <serial>abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e</serial>
Nov 09 02:18:38 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:18:38 user nova-compute[75438]: </disk>
Nov 09 02:18:38 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:18:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully detached device vdb from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the persistent domain config.
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:18:38 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:18:38 user nova-compute[75438]:   <source dev="/dev/sde"/>
Nov 09 02:18:38 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:18:38 user nova-compute[75438]:   <serial>abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e</serial>
Nov 09 02:18:38 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:18:38 user nova-compute[75438]: </disk>
Nov 09 02:18:38 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:18:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [{"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:18:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:50 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3b47518-63f5-4a38-834d-5627bec3892d is timed out.
Nov 09 02:18:50 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully detached device vdb from instance a3b47518-63f5-4a38-834d-5627bec3892d from the live domain config.
Nov 09 02:18:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JMHgCcRt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:18:50 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4cfd88-059e-4b4d-856b-e824fd003dab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:18:50 user nova-compute[75438]: No targets found.
Nov 09 02:18:50 user nova-compute[75438]: iSNS:
Nov 09 02:18:50 user nova-compute[75438]: No targets found.
Nov 09 02:18:50 user nova-compute[75438]: STATIC:
Nov 09 02:18:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:18:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a
Nov 09 02:18:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:18:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab
Nov 09 02:18:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e
Nov 09 02:18:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128
Nov 09 02:18:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:50 user nova-compute[75438]: FIRMWARE:
Nov 09 02:18:50 user nova-compute[75438]: No targets found.
Nov 09 02:18:50 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:18:50 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:18:50 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:18:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4365dbd1-9d60-4995-9bf4-54d1a860349e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c921ac-96b6-4b6d-a700-5c952d801146]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:18:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:51 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:18:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba241345e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a8ac96-70b3-41bb-bb87-7c8d46565fdf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c886869-b7b3-4629-9597-6cf10ae8bfbe]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[51835078-ee94-4fe2-852a-e7281a9f18e2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dff060-e6ee-4b06-bb00-2fa0f6e399b5]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fce465-a5db-4646-852c-af200092d986]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f1ed61-471b-4e51-a5d8-4ebf007232c5]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260]
Nov 09 02:18:51 user nova-compute[75438]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a, portal: 172.16.0.220,3260] successful.
Nov 09 02:18:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc1e01dc-86c0-473d-a4a5-d1509479d43a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74a39b0-dcbe-40f9-81b9-d7dc253ceb41]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== disconnect_volume: return (328ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:18:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:18:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'flavor' on Instance uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:18:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-388bceea-04c5-44aa-b5a0-c9d2565b968a tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.939s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:18:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:18:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:18:58 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 is timed out.
Nov 09 02:18:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully detached device vdb from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the live domain config.
Nov 09 02:18:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKzocwus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:18:58 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa23679-703d-430c-9ecf-0b6050e43403]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:18:58 user nova-compute[75438]: No targets found.
Nov 09 02:18:58 user nova-compute[75438]: iSNS:
Nov 09 02:18:58 user nova-compute[75438]: No targets found.
Nov 09 02:18:58 user nova-compute[75438]: STATIC:
Nov 09 02:18:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:18:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:18:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab
Nov 09 02:18:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e
Nov 09 02:18:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:58 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128
Nov 09 02:18:58 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:18:58 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:18:58 user nova-compute[75438]: FIRMWARE:
Nov 09 02:18:58 user nova-compute[75438]: No targets found.
Nov 09 02:18:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:18:58 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:18:58 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[855cfeaf-69e3-4f00-a8e6-e1366d1c1cdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d62d83-0fc9-4bc3-bf6a-ad39f607cffd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:18:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:18:58 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:18:58 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba244ca710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e'): ({'sde'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Removing single pathed devices sde {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[214465d6-c8b5-4c66-9aa4-a1bec483b3ad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0084f2-eac4-4f85-851a-be7d0d1f2866]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flushing IO for device /dev/sde {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a71681-1977-4b0f-b474-a397a20cbdb1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc28e61-8883-4ad6-9b4f-ecbe94d7daf6]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] SCSI volumes sde have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:18:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9b48f-a316-4ba2-82b1-4af29eec1e30]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ec4686-dc4d-4575-b1fc-a68e3d380569]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260]
Nov 09 02:18:59 user nova-compute[75438]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e, portal: 172.16.0.220,3260] successful.
Nov 09 02:18:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abda8c9c-8ef9-4a3b-97e7-ec7c4e64506e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da07eea-a029-4b6b-acff-004c43dea773]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== disconnect_volume: return (350ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:18:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:00 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7432edfe-889c-49df-bbaf-6efc0e558f48 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.222s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:01 user nova-compute[75438]: INFO nova.compute.manager [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Detaching volume f4c4ba64-6e32-4710-8a54-da04efef6aab
Nov 09 02:19:01 user nova-compute[75438]: INFO nova.virt.block_device [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Attempting to driver detach volume f4c4ba64-6e32-4710-8a54-da04efef6aab from mountpoint /dev/vdc
Nov 09 02:19:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Attempting to detach device vdc from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:19:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:19:01 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:19:01 user nova-compute[75438]:   <source dev="/dev/sdg"/>
Nov 09 02:19:01 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:19:01 user nova-compute[75438]:   <serial>f4c4ba64-6e32-4710-8a54-da04efef6aab</serial>
Nov 09 02:19:01 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 02:19:01 user nova-compute[75438]: </disk>
Nov 09 02:19:01 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:19:01 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully detached device vdc from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the persistent domain config.
Nov 09 02:19:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:19:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:19:01 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:19:01 user nova-compute[75438]:   <source dev="/dev/sdg"/>
Nov 09 02:19:01 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:19:01 user nova-compute[75438]:   <serial>f4c4ba64-6e32-4710-8a54-da04efef6aab</serial>
Nov 09 02:19:01 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 02:19:01 user nova-compute[75438]: </disk>
Nov 09 02:19:01 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:19:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:19:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid e2cc1833-7812-4534-aa5a-b793f37b5254 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid c2f689e5-afcc-4043-8ac1-3ff999a702da {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "074d5809-da5f-4158-83e1-651c8518efaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "074d5809-da5f-4158-83e1-651c8518efaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:19:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:06 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:19:06 user nova-compute[75438]: INFO nova.compute.claims [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Claim successful on node user
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:19:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.policy [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f241dbd509b4beb8148222f8379d58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374722030e844844b670f169c722977c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:19:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Creating image(s)
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "/opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk 1073741824" returned: 0 in 0.066s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Successfully created port: 99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Cannot resize image /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Ensure instance console log exists: /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Successfully updated port: 99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquired lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-changed-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Refreshing instance network info cache due to event network-changed-99bc17a1-de88-401d-845f-e12d919a1668. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:19:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] Acquiring lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updating instance_info_cache with network_info: [{"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Releasing lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Instance network_info: |[{"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] Acquired lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.neutron [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Refreshing network info cache for port 99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Start _get_guest_xml network_info=[{"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:19:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:19:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462279227',display_name='tempest-AttachVolumeNegativeTest-server-462279227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462279227',id=29,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvEt5yPmql5KrwJhb2mnFD05e2OolrozjEJO4ht7hYRjgD5vcMGjCelvWEFm3cR8AbzmbwPqBxpebn6vjUGl3GqtMzowaFxN1XjzpxBGEoBYgg9Ya0QL6Il5iVTsBZe7g==',key_name='tempest-keypair-1743980706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-s6jt94xk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=2efbcfcc-01ed-4773-bf45-d72ac07870e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'pci_devices' on Instance uuid 2efbcfcc-01ed-4773-bf45-d72ac07870e8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:19:09 user nova-compute[75438]:   <uuid>2efbcfcc-01ed-4773-bf45-d72ac07870e8</uuid>
Nov 09 02:19:09 user nova-compute[75438]:   <name>instance-0000001d</name>
Nov 09 02:19:09 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:19:09 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:19:09 user nova-compute[75438]:   <metadata>
Nov 09 02:19:09 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:19:09 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:19:09 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeNegativeTest-server-462279227</nova:name>
Nov 09 02:19:09 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:19:09</nova:creationTime>
Nov 09 02:19:09 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:19:09 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:19:09 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:19:09 user nova-compute[75438]:       <nova:owner>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:user uuid="1f241dbd509b4beb8148222f8379d58e">tempest-AttachVolumeNegativeTest-1037659816-project-member</nova:user>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:project uuid="374722030e844844b670f169c722977c">tempest-AttachVolumeNegativeTest-1037659816</nova:project>
Nov 09 02:19:09 user nova-compute[75438]:       </nova:owner>
Nov 09 02:19:09 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:19:09 user nova-compute[75438]:       <nova:ports>
Nov 09 02:19:09 user nova-compute[75438]:         <nova:port uuid="99bc17a1-de88-401d-845f-e12d919a1668">
Nov 09 02:19:09 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:19:09 user nova-compute[75438]:         </nova:port>
Nov 09 02:19:09 user nova-compute[75438]:       </nova:ports>
Nov 09 02:19:09 user nova-compute[75438]:     </nova:instance>
Nov 09 02:19:09 user nova-compute[75438]:   </metadata>
Nov 09 02:19:09 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:19:09 user nova-compute[75438]:     <system>
Nov 09 02:19:09 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:19:09 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:19:09 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:19:09 user nova-compute[75438]:       <entry name="serial">2efbcfcc-01ed-4773-bf45-d72ac07870e8</entry>
Nov 09 02:19:09 user nova-compute[75438]:       <entry name="uuid">2efbcfcc-01ed-4773-bf45-d72ac07870e8</entry>
Nov 09 02:19:09 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:19:09 user nova-compute[75438]:     </system>
Nov 09 02:19:09 user nova-compute[75438]:   </sysinfo>
Nov 09 02:19:09 user nova-compute[75438]:   <os>
Nov 09 02:19:09 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:19:09 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:19:09 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:19:09 user nova-compute[75438]:   </os>
Nov 09 02:19:09 user nova-compute[75438]:   <features>
Nov 09 02:19:09 user nova-compute[75438]:     <acpi/>
Nov 09 02:19:09 user nova-compute[75438]:     <apic/>
Nov 09 02:19:09 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:19:09 user nova-compute[75438]:   </features>
Nov 09 02:19:09 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:19:09 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:19:09 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:19:09 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:19:09 user nova-compute[75438]:   </clock>
Nov 09 02:19:09 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:19:09 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:19:09 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:19:09 user nova-compute[75438]:   </cpu>
Nov 09 02:19:09 user nova-compute[75438]:   <devices>
Nov 09 02:19:09 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:19:09 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:19:09 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk"/>
Nov 09 02:19:09 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:19:09 user nova-compute[75438]:     </disk>
Nov 09 02:19:09 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:19:09 user nova-compute[75438]:       <mac address="fa:16:3e:db:78:11"/>
Nov 09 02:19:09 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:19:09 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:19:09 user nova-compute[75438]:       <target dev="tap99bc17a1-de"/>
Nov 09 02:19:09 user nova-compute[75438]:     </interface>
Nov 09 02:19:09 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:19:09 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/console.log" append="off"/>
Nov 09 02:19:09 user nova-compute[75438]:     </serial>
Nov 09 02:19:09 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:19:09 user nova-compute[75438]:     <video>
Nov 09 02:19:09 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:19:09 user nova-compute[75438]:     </video>
Nov 09 02:19:09 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:19:09 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:19:09 user nova-compute[75438]:     </rng>
Nov 09 02:19:09 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:19:09 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:19:09 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:19:09 user nova-compute[75438]:     </memballoon>
Nov 09 02:19:09 user nova-compute[75438]:   </devices>
Nov 09 02:19:09 user nova-compute[75438]: </domain>
Nov 09 02:19:09 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462279227',display_name='tempest-AttachVolumeNegativeTest-server-462279227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462279227',id=29,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvEt5yPmql5KrwJhb2mnFD05e2OolrozjEJO4ht7hYRjgD5vcMGjCelvWEFm3cR8AbzmbwPqBxpebn6vjUGl3GqtMzowaFxN1XjzpxBGEoBYgg9Ya0QL6Il5iVTsBZe7g==',key_name='tempest-keypair-1743980706',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-s6jt94xk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=2efbcfcc-01ed-4773-bf45-d72ac07870e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG os_vif [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c0de281-f976-5c0a-b594-fa4131062639', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99bc17a1-de, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99bc17a1-de, col_values=(('qos', UUID('30029f74-c7ec-4165-8031-d2bc0032e4a4')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99bc17a1-de, col_values=(('external_ids', {'iface-id': '99bc17a1-de88-401d-845f-e12d919a1668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:78:11', 'vm-uuid': '2efbcfcc-01ed-4773-bf45-d72ac07870e8'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:09 user nova-compute[75438]: INFO os_vif [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de')
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:db:78:11, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.neutron [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updated VIF entry in instance network info cache for port 99bc17a1-de88-401d-845f-e12d919a1668. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG nova.network.neutron [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updating instance_info_cache with network_info: [{"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d8b51937-f0dc-42c1-b84d-f3c08a2e451e req-73f4017c-3988-4e09-ad1e-d624a9762757 service nova] Releasing lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:19:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-20b68984-d735-4092-93a0-578921e0aceb req-f67a169d-ba56-4e4a-b1b8-133f9462338e service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-20b68984-d735-4092-93a0-578921e0aceb req-f67a169d-ba56-4e4a-b1b8-133f9462338e service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-20b68984-d735-4092-93a0-578921e0aceb req-f67a169d-ba56-4e4a-b1b8-133f9462338e service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-20b68984-d735-4092-93a0-578921e0aceb req-f67a169d-ba56-4e4a-b1b8-133f9462338e service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-20b68984-d735-4092-93a0-578921e0aceb req-f67a169d-ba56-4e4a-b1b8-133f9462338e service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:11 user nova-compute[75438]: WARNING nova.compute.manager [req-20b68984-d735-4092-93a0-578921e0aceb req-f67a169d-ba56-4e4a-b1b8-133f9462338e service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received unexpected event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with vm_state building and task_state spawning.
Nov 09 02:19:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:19:13 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Instance spawned successfully.
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:13 user nova-compute[75438]: WARNING nova.compute.manager [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received unexpected event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with vm_state building and task_state spawning.
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-changed-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Refreshing instance network info cache due to event network-changed-9cbd945f-fb48-48b9-ba20-178b54a7f26b. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] Acquiring lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] Acquired lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Refreshing network info cache for port 9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:19:13 user nova-compute[75438]: INFO nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:19:13 user nova-compute[75438]: INFO nova.compute.manager [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Took 6.41 seconds to build instance.
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b6c664b1-3f70-4ba7-9ceb-9df99f03e295 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.501s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updated VIF entry in instance network info cache for port 9cbd945f-fb48-48b9-ba20-178b54a7f26b. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating instance_info_cache with network_info: [{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4448a1a1-2d70-4d22-9da7-b8f017301803 req-6acab934-f9b1-4c1f-8dd6-c6d368601cee service nova] Releasing lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:19:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:19 user nova-compute[75438]: INFO nova.compute.manager [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Terminating instance
Nov 09 02:19:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-35d85bdc-3101-413f-8941-a9cd97bc7391 req-dd3723cc-13f4-4f3e-99a7-4834dd068712 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-unplugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35d85bdc-3101-413f-8941-a9cd97bc7391 req-dd3723cc-13f4-4f3e-99a7-4834dd068712 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35d85bdc-3101-413f-8941-a9cd97bc7391 req-dd3723cc-13f4-4f3e-99a7-4834dd068712 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-35d85bdc-3101-413f-8941-a9cd97bc7391 req-dd3723cc-13f4-4f3e-99a7-4834dd068712 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-35d85bdc-3101-413f-8941-a9cd97bc7391 req-dd3723cc-13f4-4f3e-99a7-4834dd068712 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-unplugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-35d85bdc-3101-413f-8941-a9cd97bc7391 req-dd3723cc-13f4-4f3e-99a7-4834dd068712 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-unplugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:19:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Instance destroyed successfully.
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lazy-loading 'resources' on Instance uuid 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1844743210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-594334493',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5tur4KHsYWmYr5apfE+nTJUUV0P9vgLOi9qtfxKdVRfN7Z/ln6xZmAnG5/s4YQ5a62+x2A+XbtT/mc9SdFYtWXrp+O6WCdeNIwExdi3ksz4Re8DoIPfr3LiQfM71S8A==',key_name='tempest-keypair-959261134',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b90a39ccf04453387605602fd424452',ramdisk_id='',reservation_id='r-f42cnvuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1084561406',owner_user_name='tempest-ServerActionsV293TestJSON-1084561406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d42bf053761842be974389361ec9f89e',uuid=84a69147-dc3e-4bd3-83e0-4656d2d8ea16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converting VIF {"id": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "address": "fa:16:3e:38:0d:bb", "network": {"id": "ffaa10ce-5839-4c39-b976-61d964e15b8f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1027910246-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b90a39ccf04453387605602fd424452", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7ebd43-e9", "ovs_interfaceid": "2b7ebd43-e9ca-4321-8276-0a43621c89a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_vif [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b7ebd43-e9, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cab60fe0-9118-4569-8834-8f32d8798354) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:20 user nova-compute[75438]: INFO os_vif [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:0d:bb,bridge_name='br-int',has_traffic_filtering=True,id=2b7ebd43-e9ca-4321-8276-0a43621c89a1,network=Network(ffaa10ce-5839-4c39-b976-61d964e15b8f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7ebd43-e9')
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdcZEqPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:19:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7310132f-c155-4221-9559-dfee401618f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:19:20 user nova-compute[75438]: No targets found.
Nov 09 02:19:20 user nova-compute[75438]: iSNS:
Nov 09 02:19:20 user nova-compute[75438]: No targets found.
Nov 09 02:19:20 user nova-compute[75438]: STATIC:
Nov 09 02:19:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:19:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba
Nov 09 02:19:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab
Nov 09 02:19:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128
Nov 09 02:19:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:20 user nova-compute[75438]: FIRMWARE:
Nov 09 02:19:20 user nova-compute[75438]: No targets found.
Nov 09 02:19:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:19:20 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:19:20 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c587acfb-f8be-4dd1-86ed-bd96ac678b23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7638c6d-e285-41e0-a006-a8741d71fc8c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:20 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:19:20 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:20 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:19:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:20 user nova-compute[75438]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba (non-flash)
Nov 09 02:19:20 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:20 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:19:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba043b2950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed39cb2-3555-4f46-80fd-a421e94cdeed]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97558f14-9236-4a83-87b0-1fdea48829b5]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[037181b5-34b2-4ecb-8700-9767c576a3ea]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adddd73-1df1-4e9e-89c8-f2d014cc44e4]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:20 user nova-compute[75438]: INFO nova.compute.manager [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attaching volume 2f146736-c630-48f4-892f-d4c160677cea to /dev/vdb
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c20440a7', '/dev/disk/by-id/scsi-23461663336336461', '/dev/disk/by-id/scsi-1SCST_BIOc20440a7-4af363dabb3e8c34') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e6591-9aba-4cd6-b40e-ed9343c24594]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7deeecb-af75-4ba2-848c-6651c0a900ad]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.utils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c89999-9a2b-4ad9-9eb6-d0058bf5d42c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb42acc-bcb3-457d-9479-cbf7c064f4b2]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260]
Nov 09 02:19:20 user nova-compute[75438]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba, portal: 172.16.0.220,3260] successful.
Nov 09 02:19:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e894eb3-391b-434e-b56a-3e24237601ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dcde84f2-18d7-4352-bdcd-969ba7a227ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5660b001-dfe0-4307-9eb4-96c782610170]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] <== disconnect_volume: return (373ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:19:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Deleting instance files /opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16_del
Nov 09 02:19:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Deletion of /opt/stack/data/nova/instances/84a69147-dc3e-4bd3-83e0-4656d2d8ea16_del complete
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b430e4c0-973f-4ce1-9ca6-9158161913ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[633242a4-8c47-4ede-afb1-255989d59d07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:19:20 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b389309-59a6-480e-8568-d128688303a2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG os_brick.utils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating existing volume attachment record: d49bb642-d447-4e53-9ec1-2e5205d41bee {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:19:20 user nova-compute[75438]: INFO nova.compute.manager [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:20 user nova-compute[75438]: INFO nova.compute.manager [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Terminating instance
Nov 09 02:19:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Instance destroyed successfully.
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.objects.instance [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'resources' on Instance uuid a3b47518-63f5-4a38-834d-5627bec3892d {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:12:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1069873586',display_name='tempest-ServerActionsTestOtherA-server-1259510329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1069873586',id=20,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEY0jLkcGufpfBdu/y9o49RBsRGgTXVSjBjf2C7iYfthjQWpmZCBzLxp9Vt68/r4MB2JcjuWyuMtgyxlmcrRIR84pgpDcpS6QpDg62POpG8vOnhxC2w0TRYFSJLpyoKA6w==',key_name='tempest-keypair-355792053',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:16:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-xxvqv43c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=a3b47518-63f5-4a38-834d-5627bec3892d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "address": "fa:16:3e:b0:5e:44", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40acfb20-c0", "ovs_interfaceid": "40acfb20-c0f4-47b9-a8c5-87cec6f4f24f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_vif [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40acfb20-c0, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a900facd-5203-44a0-8769-6403cf33cd52) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:21 user nova-compute[75438]: INFO os_vif [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5e:44,bridge_name='br-int',has_traffic_filtering=True,id=40acfb20-c0f4-47b9-a8c5-87cec6f4f24f,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40acfb20-c0')
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Deleting instance files /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d_del
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Deletion of /opt/stack/data/nova/instances/a3b47518-63f5-4a38-834d-5627bec3892d_del complete
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Took 1.01 seconds to deallocate network for instance.
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-46146136-8168-4930-996c-674ddc2a77b6 req-c5eb17f9-ef2e-4d76-8eaa-1420fcaf25a3 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-deleted-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.compute.manager [req-46146136-8168-4930-996c-674ddc2a77b6 req-c5eb17f9-ef2e-4d76-8eaa-1420fcaf25a3 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Neutron deleted interface 2b7ebd43-e9ca-4321-8276-0a43621c89a1; detaching it from the instance and deleting it from the info cache
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.network.neutron [req-46146136-8168-4930-996c-674ddc2a77b6 req-c5eb17f9-ef2e-4d76-8eaa-1420fcaf25a3 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:21 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 is timed out.
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully detached device vdc from instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 from the live domain config.
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DRnTvrsB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:19:21 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-46146136-8168-4930-996c-674ddc2a77b6 req-c5eb17f9-ef2e-4d76-8eaa-1420fcaf25a3 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Detach interface failed, port_id=2b7ebd43-e9ca-4321-8276-0a43621c89a1, reason: Instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:19:21 user nova-compute[75438]: INFO nova.compute.manager [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee3c24-8b91-4c0a-b979-44c247351449]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:19:21 user nova-compute[75438]: No targets found.
Nov 09 02:19:21 user nova-compute[75438]: iSNS:
Nov 09 02:19:21 user nova-compute[75438]: No targets found.
Nov 09 02:19:21 user nova-compute[75438]: STATIC:
Nov 09 02:19:21 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:19:21 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:21 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:21 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab
Nov 09 02:19:21 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:21 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:21 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128
Nov 09 02:19:21 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:21 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:21 user nova-compute[75438]: FIRMWARE:
Nov 09 02:19:21 user nova-compute[75438]: No targets found.
Nov 09 02:19:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:19:21 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:19:21 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a53f5-dd56-4e7e-a4e3-01a8198123c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9b890d-7ba3-42bd-b0d8-e25ac0fa067b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:21 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:21 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:19:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:21 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:21 user nova-compute[75438]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab (non-flash)
Nov 09 02:19:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0430c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab'): ({'sdg'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Removing single pathed devices sdg {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de4a49-e360-47e7-92da-ef1ed6482c7b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28be787-96df-4288-99c5-88756fa02007]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Flushing IO for device /dev/sdg {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bafd404-65d9-41f9-bbea-235762f893e5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Acquiring lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] No waiting events found dispatching network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:21 user nova-compute[75438]: WARNING nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Received unexpected event network-vif-plugged-2b7ebd43-e9ca-4321-8276-0a43621c89a1 for instance with vm_state active and task_state deleting.
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-unplugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-unplugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-unplugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Acquiring lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] Lock "a3b47518-63f5-4a38-834d-5627bec3892d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] No waiting events found dispatching network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:21 user nova-compute[75438]: WARNING nova.compute.manager [req-b3ebf0d6-6ab2-4c3f-afe0-fd34070c7c11 req-2452db09-09c3-4c69-a8d1-c498d8ee9383 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received unexpected event network-vif-plugged-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f for instance with vm_state active and task_state deleting.
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2f134-1e77-4d5c-8d7a-ed5101373581]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] SCSI volumes sdg have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81be824-1919-471d-90b1-98b1eaa2425e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf80b61-ad4e-4bc0-9eb8-a628ff7be0b4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260]
Nov 09 02:19:21 user nova-compute[75438]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab, portal: 172.16.0.220,3260] successful.
Nov 09 02:19:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4c4ba64-6e32-4710-8a54-da04efef6aab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[917a3255-2f61-488d-80f5-2e14cabe6269]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] <== disconnect_volume: return (342ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:19:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:19:22 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:22 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Took 0.83 seconds to deallocate network for instance.
Nov 09 02:19:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:22 user nova-compute[75438]: INFO nova.compute.manager [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Took 1.06 seconds to detach 1 volumes for instance.
Nov 09 02:19:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] [instance: 84a69147-dc3e-4bd3-83e0-4656d2d8ea16] Deleting volume: dcde84f2-18d7-4352-bdcd-969ba7a227ba {{(pid=75438) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 02:19:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.536s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.180s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:23 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Deleted allocations for instance a3b47518-63f5-4a38-834d-5627bec3892d
Nov 09 02:19:23 user nova-compute[75438]: DEBUG nova.objects.instance [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'flavor' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-041ad2be-b3ac-487a-b3ce-7150a87c63f3 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.295s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1f190a8f-0dc8-4e43-8ff0-d7f5dc09028b tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "a3b47518-63f5-4a38-834d-5627bec3892d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.611s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.086s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-437fbb3b-b6bd-4a20-a060-4e40337e10cb req-528a980a-c944-4358-9f20-203320e6e972 service nova] [instance: a3b47518-63f5-4a38-834d-5627bec3892d] Received event network-vif-deleted-40acfb20-c0f4-47b9-a8c5-87cec6f4f24f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:23 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Deleted allocations for instance 84a69147-dc3e-4bd3-83e0-4656d2d8ea16
Nov 09 02:19:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5f7e373-7630-475e-9e5a-71cc73d4341a tempest-ServerActionsV293TestJSON-1084561406 tempest-ServerActionsV293TestJSON-1084561406-project-member] Lock "84a69147-dc3e-4bd3-83e0-4656d2d8ea16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.502s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:24 user nova-compute[75438]: INFO nova.compute.manager [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Terminating instance
Nov 09 02:19:24 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-a65a2d5a-7cde-46b5-8536-518352edab88 req-0781bfbe-298e-4f7e-9cbf-cf14176b6306 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-vif-unplugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a65a2d5a-7cde-46b5-8536-518352edab88 req-0781bfbe-298e-4f7e-9cbf-cf14176b6306 service nova] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a65a2d5a-7cde-46b5-8536-518352edab88 req-0781bfbe-298e-4f7e-9cbf-cf14176b6306 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a65a2d5a-7cde-46b5-8536-518352edab88 req-0781bfbe-298e-4f7e-9cbf-cf14176b6306 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-a65a2d5a-7cde-46b5-8536-518352edab88 req-0781bfbe-298e-4f7e-9cbf-cf14176b6306 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] No waiting events found dispatching network-vif-unplugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-a65a2d5a-7cde-46b5-8536-518352edab88 req-0781bfbe-298e-4f7e-9cbf-cf14176b6306 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-vif-unplugged-4228b3fa-1303-4e30-85d4-dcba154f828b for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:19:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Instance destroyed successfully.
Nov 09 02:19:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lazy-loading 'resources' on Instance uuid 3ce04a63-a5b1-4945-82f9-ebd03614f722 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:15:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1193686961',display_name='tempest-AttachVolumeTestJSON-server-1193686961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1193686961',id=26,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdy3VWEfAlfb+M1a7ZgKzfyEXiFwFHTBpfw6+F2QlCUAKyd+5Fz8AWN2IhYHRB9G9izS7JxCEh23YB6gHXC0b+IhlTHehYd2zix6+v7PYip1wKbI67hm470lq6wBfW0XA==',key_name='tempest-keypair-656286225',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be67d22752084a76b41a4e1cff3747cf',ramdisk_id='',reservation_id='r-x9dphhfg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-74588244',owner_user_name='tempest-AttachVolumeTestJSON-74588244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6a26a0160e8042e3a6a83bdb28a41ad0',uuid=3ce04a63-a5b1-4945-82f9-ebd03614f722,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converting VIF {"id": "4228b3fa-1303-4e30-85d4-dcba154f828b", "address": "fa:16:3e:8d:78:22", "network": {"id": "d6dd58d5-37ab-4138-9258-10961e7405f1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1144847783-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be67d22752084a76b41a4e1cff3747cf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4228b3fa-13", "ovs_interfaceid": "4228b3fa-1303-4e30-85d4-dcba154f828b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG os_vif [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4228b3fa-13, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5eca810-baf1-47f6-835b-0bd366f3c75d) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:25 user nova-compute[75438]: INFO os_vif [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:78:22,bridge_name='br-int',has_traffic_filtering=True,id=4228b3fa-1303-4e30-85d4-dcba154f828b,network=Network(d6dd58d5-37ab-4138-9258-10961e7405f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4228b3fa-13')
Nov 09 02:19:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Deleting instance files /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722_del
Nov 09 02:19:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Deletion of /opt/stack/data/nova/instances/3ce04a63-a5b1-4945-82f9-ebd03614f722_del complete
Nov 09 02:19:25 user nova-compute[75438]: INFO nova.compute.manager [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 09 02:19:25 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:19:25 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:26 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Took 0.94 seconds to deallocate network for instance.
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-e376e43c-a72b-45e5-aa20-192f5fd7f67f req-cb49d7bd-c532-4ed8-b073-f9007a017f96 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-vif-deleted-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:26 user nova-compute[75438]: INFO nova.compute.manager [req-e376e43c-a72b-45e5-aa20-192f5fd7f67f req-cb49d7bd-c532-4ed8-b073-f9007a017f96 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Neutron deleted interface 4228b3fa-1303-4e30-85d4-dcba154f828b; detaching it from the instance and deleting it from the info cache
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-e376e43c-a72b-45e5-aa20-192f5fd7f67f req-cb49d7bd-c532-4ed8-b073-f9007a017f96 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-e376e43c-a72b-45e5-aa20-192f5fd7f67f req-cb49d7bd-c532-4ed8-b073-f9007a017f96 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Detach interface failed, port_id=4228b3fa-1303-4e30-85d4-dcba154f828b, reason: Instance 3ce04a63-a5b1-4945-82f9-ebd03614f722 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-ea21b02e-58f4-4163-b922-b98b189d1082 req-503e90e0-e60f-40eb-b328-acf5f96c2914 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received event network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ea21b02e-58f4-4163-b922-b98b189d1082 req-503e90e0-e60f-40eb-b328-acf5f96c2914 service nova] Acquiring lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ea21b02e-58f4-4163-b922-b98b189d1082 req-503e90e0-e60f-40eb-b328-acf5f96c2914 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ea21b02e-58f4-4163-b922-b98b189d1082 req-503e90e0-e60f-40eb-b328-acf5f96c2914 service nova] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-ea21b02e-58f4-4163-b922-b98b189d1082 req-503e90e0-e60f-40eb-b328-acf5f96c2914 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] No waiting events found dispatching network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:26 user nova-compute[75438]: WARNING nova.compute.manager [req-ea21b02e-58f4-4163-b922-b98b189d1082 req-503e90e0-e60f-40eb-b328-acf5f96c2914 service nova] [instance: 3ce04a63-a5b1-4945-82f9-ebd03614f722] Received unexpected event network-vif-plugged-4228b3fa-1303-4e30-85d4-dcba154f828b for instance with vm_state deleted and task_state None.
Nov 09 02:19:26 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Deleted allocations for instance 3ce04a63-a5b1-4945-82f9-ebd03614f722
Nov 09 02:19:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc938ee-cd7f-41aa-852b-a8544e567e78 tempest-AttachVolumeTestJSON-74588244 tempest-AttachVolumeTestJSON-74588244-project-member] Lock "3ce04a63-a5b1-4945-82f9-ebd03614f722" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:28 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:33 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:19:33 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7425MB free_disk=24.831832885742188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance c2f689e5-afcc-4043-8ac1-3ff999a702da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 896758d5-8945-4fb7-a90f-a86084c7fd3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:19:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:19:34 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:34 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:19:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:19:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:19:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYrftJzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:19:45 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:19:45 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:19:45 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d94502-3294-4c6c-bbfd-90e58b96cdd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:19:45 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[00302819-d63d-4c15-b01a-35f0a0315317]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea] added
Nov 09 02:19:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d946bcb-6bed-4e94-a564-2783b8f4a4f8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd451d96-e829-47ac-a097-f65db0038409]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYrftJzW {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xYrftJzW" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae31a27-740b-49a2-8913-adb434aa3805]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xYrftJzW'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d1af41-2e0b-4b64-8368-ac30a21d5a5f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffdd821-00e8-4646-a858-ee60e6bc326e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dfe974-a044-43ec-bb07-763834b78360]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260]
Nov 09 02:19:45 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260] successful.
Nov 09 02:19:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[966b4f6e-05a2-4efb-b594-1046cdd84de7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b889f75-dbea-466f-8f35-f137e039d8dd]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:19:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:45 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:19:45 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c586926d-f52c-4ff8-8772-25407dec96bd]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:19:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYrftJzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:19:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:19:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26432346233363332', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:19:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432346233363332', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:19:46 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:19:46 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:19:46 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:19:46 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:19:46 user nova-compute[75438]:   <serial>2f146736-c630-48f4-892f-d4c160677cea</serial>
Nov 09 02:19:46 user nova-compute[75438]: </disk>
Nov 09 02:19:46 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:19:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:19:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:19:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No VIF found with MAC fa:16:3e:03:d7:69, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:19:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86a1688-25ca-46f1-b925-be0840c12a23 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.932s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing instance network info cache due to event network-changed-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] Acquiring lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] Acquired lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.network.neutron [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Refreshing network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:48 user nova-compute[75438]: INFO nova.compute.manager [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Terminating instance
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-a555fa50-de33-4851-89f4-39e52e136efa req-73914769-adaf-4bb7-9b1b-63a1ad2b4b9a service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-unplugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a555fa50-de33-4851-89f4-39e52e136efa req-73914769-adaf-4bb7-9b1b-63a1ad2b4b9a service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a555fa50-de33-4851-89f4-39e52e136efa req-73914769-adaf-4bb7-9b1b-63a1ad2b4b9a service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a555fa50-de33-4851-89f4-39e52e136efa req-73914769-adaf-4bb7-9b1b-63a1ad2b4b9a service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-a555fa50-de33-4851-89f4-39e52e136efa req-73914769-adaf-4bb7-9b1b-63a1ad2b4b9a service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-unplugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-a555fa50-de33-4851-89f4-39e52e136efa req-73914769-adaf-4bb7-9b1b-63a1ad2b4b9a service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-unplugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:48 user nova-compute[75438]: INFO nova.compute.manager [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Terminating instance
Nov 09 02:19:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Instance destroyed successfully.
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lazy-loading 'resources' on Instance uuid 896758d5-8945-4fb7-a90f-a86084c7fd3a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:13:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-808013591',display_name='tempest-TestShelveInstance-server-808013591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-808013591',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlSBy/yEAN4Bi6etvD69gybdSwpkK9G4pYaYUcbe28q3nopNHbXNhwzJ7FXx7caugmEOAgerY48VBohwKxF85Y10hH+MaDCPyz1ofFYxWEZsPEDz/fGE40rgHQ6MMX8Cw==',key_name='tempest-TestShelveInstance-1475462915',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:18:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c37c1382f74f9689baf00837b8bfa8',ramdisk_id='',reservation_id='r-iysa0vvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-838005507',owner_user_name='tempest-TestShelveInstance-838005507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:18:16Z,user_data=None,user_id='2959b8b821e9406480159ced072408e6',uuid=896758d5-8945-4fb7-a90f-a86084c7fd3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converting VIF {"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_vif [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dcd4f57-48, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=616d217c-c59f-48d4-ab04-fe6ece33518d) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: INFO os_vif [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:14:79,bridge_name='br-int',has_traffic_filtering=True,id=0dcd4f57-485c-406e-9e6c-7f9dfb5865d8,network=Network(51bec8ae-a657-43a3-9ff5-c90166b5529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcd4f57-48')
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updated VIF entry in instance network info cache for port 0dcd4f57-485c-406e-9e6c-7f9dfb5865d8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [{"id": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "address": "fa:16:3e:21:14:79", "network": {"id": "51bec8ae-a657-43a3-9ff5-c90166b5529c", "bridge": "br-int", "label": "tempest-TestShelveInstance-444624924-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c37c1382f74f9689baf00837b8bfa8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcd4f57-48", "ovs_interfaceid": "0dcd4f57-485c-406e-9e6c-7f9dfb5865d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hnaMHekt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:19:49 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d71aa43-e913-4409-96d8-e823e6e3158f req-8901d89c-3902-4b46-a97d-dd96f79ac4f6 service nova] Releasing lock "refresh_cache-896758d5-8945-4fb7-a90f-a86084c7fd3a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d103fe-84c0-4ee2-9e91-f432e4857bff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:19:49 user nova-compute[75438]: No targets found.
Nov 09 02:19:49 user nova-compute[75438]: iSNS:
Nov 09 02:19:49 user nova-compute[75438]: No targets found.
Nov 09 02:19:49 user nova-compute[75438]: STATIC:
Nov 09 02:19:49 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:19:49 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:49 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:49 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea
Nov 09 02:19:49 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:49 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:49 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128
Nov 09 02:19:49 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:19:49 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:19:49 user nova-compute[75438]: FIRMWARE:
Nov 09 02:19:49 user nova-compute[75438]: No targets found.
Nov 09 02:19:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:19:49 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:19:49 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee76f61-38bd-46c4-b47d-849e94aff150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d8ba49-260c-4aad-a026-e3659ae8ac44]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:49 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:49 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:19:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:19:49 user nova-compute[75438]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 (non-flash)
Nov 09 02:19:49 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:19:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba242da170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2261801c-2ad1-49db-badb-051957571a17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e425ebc0-7b1c-4b6b-8fb7-bc514872a7e3]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dbcf28-3441-4633-a5be-80cdf119dcf9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f83554-1a5b-40a6-a4bc-b25e3766ae98]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03a039d-1f3d-4d2b-8c2e-1990f8a7ad7c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Instance destroyed successfully.
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'resources' on Instance uuid 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9718bb-b238-4315-a732-6911b0d80e70]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260]
Nov 09 02:19:49 user nova-compute[75438]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128, portal: 172.16.0.220,3260] successful.
Nov 09 02:19:49 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-296716460',display_name='tempest-ServerRescueNegativeTestJSON-server-296716460',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-296716460',id=4,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:04:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-i6k9lj2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:04:28Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "d1d3d251-36fe-4955-8d02-26d0d818069f", "address": "fa:16:3e:53:cf:94", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d3d251-36", "ovs_interfaceid": "d1d3d251-36fe-4955-8d02-26d0d818069f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_vif [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1d3d251-36, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8474c493-afaf-40ea-84dd-284bc4608ee1) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09015b7e-a26a-4bb8-afc1-972768386128 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c954a4-9551-4418-be10-5babb6df9714]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] <== disconnect_volume: return (393ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Deleting instance files /opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a_del
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Deletion of /opt/stack/data/nova/instances/896758d5-8945-4fb7-a90f-a86084c7fd3a_del complete
Nov 09 02:19:49 user nova-compute[75438]: INFO os_vif [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:cf:94,bridge_name='br-int',has_traffic_filtering=True,id=d1d3d251-36fe-4955-8d02-26d0d818069f,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d3d251-36')
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Deleting instance files /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88_del
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Deletion of /opt/stack/data/nova/instances/6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88_del complete
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.compute.manager [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:19:49 user nova-compute[75438]: INFO nova.compute.manager [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 09 02:19:49 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:19:49 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:50 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Took 0.45 seconds to deallocate network for instance.
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-unplugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-unplugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-unplugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] Acquiring lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] No waiting events found dispatching network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:50 user nova-compute[75438]: WARNING nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received unexpected event network-vif-plugged-d1d3d251-36fe-4955-8d02-26d0d818069f for instance with vm_state rescued and task_state deleting.
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-0ca5acd5-b3fe-41e7-8b4f-ccaaeaf7c10f req-3570f42a-b80e-4371-93a2-a3f993143eb6 service nova] [instance: 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88] Received event network-vif-deleted-d1d3d251-36fe-4955-8d02-26d0d818069f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:50 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Took 0.54 seconds to deallocate network for instance.
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-2e632b12-2683-462e-8b09-307328af38bb req-3395044f-e9fd-4f84-bf78-525f38d19866 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-deleted-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-8f2c393f-643a-4d99-90d3-a7786efe86c6 req-0bf3d3ab-0712-4777-a1b6-17f9ab8b3832 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8f2c393f-643a-4d99-90d3-a7786efe86c6 req-0bf3d3ab-0712-4777-a1b6-17f9ab8b3832 service nova] Acquiring lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8f2c393f-643a-4d99-90d3-a7786efe86c6 req-0bf3d3ab-0712-4777-a1b6-17f9ab8b3832 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8f2c393f-643a-4d99-90d3-a7786efe86c6 req-0bf3d3ab-0712-4777-a1b6-17f9ab8b3832 service nova] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-8f2c393f-643a-4d99-90d3-a7786efe86c6 req-0bf3d3ab-0712-4777-a1b6-17f9ab8b3832 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] No waiting events found dispatching network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:50 user nova-compute[75438]: WARNING nova.compute.manager [req-8f2c393f-643a-4d99-90d3-a7786efe86c6 req-0bf3d3ab-0712-4777-a1b6-17f9ab8b3832 service nova] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Received unexpected event network-vif-plugged-0dcd4f57-485c-406e-9e6c-7f9dfb5865d8 for instance with vm_state active and task_state deleting.
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:50 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Deleted allocations for instance 6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88
Nov 09 02:19:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-844efbbd-ed3f-4a83-a991-c0715c3c4ce9 tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "6a1d2ca0-0ebf-4d5d-b033-bb42fedbac88" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.062s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:51 user nova-compute[75438]: INFO nova.compute.manager [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Took 0.98 seconds to detach 1 volumes for instance.
Nov 09 02:19:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] [instance: 896758d5-8945-4fb7-a90f-a86084c7fd3a] Deleting volume: 09015b7e-a26a-4bb8-afc1-972768386128 {{(pid=75438) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 02:19:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:51 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:51 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:51 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Deleted allocations for instance 896758d5-8945-4fb7-a90f-a86084c7fd3a
Nov 09 02:19:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e93ae8cb-8d37-4e90-95da-03c0b25877c2 tempest-TestShelveInstance-838005507 tempest-TestShelveInstance-838005507-project-member] Lock "896758d5-8945-4fb7-a90f-a86084c7fd3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.545s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:56 user nova-compute[75438]: INFO nova.compute.manager [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Terminating instance
Nov 09 02:19:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-b8b9f878-30b1-4066-af47-9d6d37e16aa8 req-a3341830-d66e-4036-b625-ae9857dcf59d service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-vif-unplugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b8b9f878-30b1-4066-af47-9d6d37e16aa8 req-a3341830-d66e-4036-b625-ae9857dcf59d service nova] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b8b9f878-30b1-4066-af47-9d6d37e16aa8 req-a3341830-d66e-4036-b625-ae9857dcf59d service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b8b9f878-30b1-4066-af47-9d6d37e16aa8 req-a3341830-d66e-4036-b625-ae9857dcf59d service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-b8b9f878-30b1-4066-af47-9d6d37e16aa8 req-a3341830-d66e-4036-b625-ae9857dcf59d service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] No waiting events found dispatching network-vif-unplugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-b8b9f878-30b1-4066-af47-9d6d37e16aa8 req-a3341830-d66e-4036-b625-ae9857dcf59d service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-vif-unplugged-241428c7-57f9-41a3-9632-41f218a5ad3d for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Instance destroyed successfully.
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lazy-loading 'resources' on Instance uuid c2f689e5-afcc-4043-8ac1-3ff999a702da {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-781804938',display_name='tempest-ServersNegativeTestJSON-server-781804938',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-781804938',id=16,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:10:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a44c6747d124716b0bcab5f94ac82f1',ramdisk_id='',reservation_id='r-uk60jkwc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1310159943',owner_user_name='tempest-ServersNegativeTestJSON-1310159943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:10:36Z,user_data=None,user_id='173f61ba6555421b8f09a996aee60807',uuid=c2f689e5-afcc-4043-8ac1-3ff999a702da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converting VIF {"id": "241428c7-57f9-41a3-9632-41f218a5ad3d", "address": "fa:16:3e:8c:96:e3", "network": {"id": "c8e11e25-dd20-480e-b85c-168baff9eb71", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-25353057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a44c6747d124716b0bcab5f94ac82f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap241428c7-57", "ovs_interfaceid": "241428c7-57f9-41a3-9632-41f218a5ad3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG os_vif [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap241428c7-57, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef612f95-68fe-4dbe-8228-205092b8c5b2) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:19:57 user nova-compute[75438]: INFO os_vif [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:96:e3,bridge_name='br-int',has_traffic_filtering=True,id=241428c7-57f9-41a3-9632-41f218a5ad3d,network=Network(c8e11e25-dd20-480e-b85c-168baff9eb71),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap241428c7-57')
Nov 09 02:19:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Deleting instance files /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da_del
Nov 09 02:19:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Deletion of /opt/stack/data/nova/instances/c2f689e5-afcc-4043-8ac1-3ff999a702da_del complete
Nov 09 02:19:57 user nova-compute[75438]: INFO nova.compute.manager [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 09 02:19:57 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:19:57 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Took 0.45 seconds to deallocate network for instance.
Nov 09 02:19:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-c1460275-4933-46a0-b48c-e39744b0c76d req-e86b6ae0-3c55-4b02-b230-dc11de9a783e service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-vif-deleted-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:58 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Deleted allocations for instance c2f689e5-afcc-4043-8ac1-3ff999a702da
Nov 09 02:19:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38671b92-f602-4b45-b5e7-6f9092ec0207 tempest-ServersNegativeTestJSON-1310159943 tempest-ServersNegativeTestJSON-1310159943-project-member] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f0e751c-f729-4965-985c-1b8ced43f262 req-22f35f26-8150-4b93-a726-7904747a731f service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received event network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f0e751c-f729-4965-985c-1b8ced43f262 req-22f35f26-8150-4b93-a726-7904747a731f service nova] Acquiring lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f0e751c-f729-4965-985c-1b8ced43f262 req-22f35f26-8150-4b93-a726-7904747a731f service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4f0e751c-f729-4965-985c-1b8ced43f262 req-22f35f26-8150-4b93-a726-7904747a731f service nova] Lock "c2f689e5-afcc-4043-8ac1-3ff999a702da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-4f0e751c-f729-4965-985c-1b8ced43f262 req-22f35f26-8150-4b93-a726-7904747a731f service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] No waiting events found dispatching network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:19:58 user nova-compute[75438]: WARNING nova.compute.manager [req-4f0e751c-f729-4965-985c-1b8ced43f262 req-22f35f26-8150-4b93-a726-7904747a731f service nova] [instance: c2f689e5-afcc-4043-8ac1-3ff999a702da] Received unexpected event network-vif-plugged-241428c7-57f9-41a3-9632-41f218a5ad3d for instance with vm_state deleted and task_state None.
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'flavor' on Instance uuid 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:19:59 user nova-compute[75438]: INFO nova.compute.manager [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Attaching volume 6e497c27-870d-437b-b6d2-bce25d5cc77e to /dev/vdb
Nov 09 02:19:59 user nova-compute[75438]: DEBUG os_brick.utils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579e701-6977-42bd-bbbc-dc8e90d979b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b1d0f6-7ff6-4459-bb47-17c46d1182c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b99a70-bc02-481b-8187-4cb9c1425be2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a022a58f-a036-46d0-a848-6bf662b185cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:19:59 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:19:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[decfa144-e049-4fc7-a984-02bb605edd74]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG os_brick.utils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:19:59 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updating existing volume attachment record: 070ca612-d570-4403-802d-e02ab8b56a08 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:20:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-changed-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Refreshing instance network info cache due to event network-changed-b4a5af82-6853-4d74-98b6-1ee69b313efb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:20:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] Acquiring lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:20:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] Acquired lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:20:00 user nova-compute[75438]: DEBUG nova.network.neutron [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Refreshing network info cache for port b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:20:01 user nova-compute[75438]: DEBUG nova.network.neutron [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updated VIF entry in instance network info cache for port b4a5af82-6853-4d74-98b6-1ee69b313efb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:20:01 user nova-compute[75438]: DEBUG nova.network.neutron [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updating instance_info_cache with network_info: [{"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:20:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e734100-cd7e-4b40-aad8-e3e395ee62fb req-3cbe0059-8ed9-4edd-841a-d13dbfac93b7 service nova] Releasing lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:20:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:20:19 user nova-compute[75438]: INFO nova.compute.claims [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Claim successful on node user
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:20:19 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:20:19 user nova-compute[75438]: DEBUG nova.policy [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3160dcb696a24d3db8bd3a22064cbd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d490c388e64d5fbdeec47eb532482e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:20:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Creating image(s)
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "/opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk 1073741824" returned: 0 in 0.059s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Successfully created port: e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.204s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Cannot resize image /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Ensure instance console log exists: /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Successfully updated port: e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-changed-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Refreshing instance network info cache due to event network-changed-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] Acquiring lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updating instance_info_cache with network_info: [{"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Instance network_info: |[{"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] Acquired lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.neutron [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Refreshing network info cache for port e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Start _get_guest_xml network_info=[{"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:20:21 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:20:21 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142971782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142971782',id=30,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-o2czctme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:20:20Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=d287e82e-ad77-45c0-93a2-d0907410ddca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'pci_devices' on Instance uuid d287e82e-ad77-45c0-93a2-d0907410ddca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:20:21 user nova-compute[75438]:   <uuid>d287e82e-ad77-45c0-93a2-d0907410ddca</uuid>
Nov 09 02:20:21 user nova-compute[75438]:   <name>instance-0000001e</name>
Nov 09 02:20:21 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:20:21 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:20:21 user nova-compute[75438]:   <metadata>
Nov 09 02:20:21 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:20:21 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:20:21 user nova-compute[75438]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1142971782</nova:name>
Nov 09 02:20:21 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:20:21</nova:creationTime>
Nov 09 02:20:21 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:20:21 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:20:21 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:20:21 user nova-compute[75438]:       <nova:owner>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:user uuid="3160dcb696a24d3db8bd3a22064cbd7a">tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member</nova:user>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:project uuid="f7d490c388e64d5fbdeec47eb532482e">tempest-ServerBootFromVolumeStableRescueTest-1794136160</nova:project>
Nov 09 02:20:21 user nova-compute[75438]:       </nova:owner>
Nov 09 02:20:21 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:20:21 user nova-compute[75438]:       <nova:ports>
Nov 09 02:20:21 user nova-compute[75438]:         <nova:port uuid="e5b9ebef-9096-4d5b-ae91-c0dcbd095b16">
Nov 09 02:20:21 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 02:20:21 user nova-compute[75438]:         </nova:port>
Nov 09 02:20:21 user nova-compute[75438]:       </nova:ports>
Nov 09 02:20:21 user nova-compute[75438]:     </nova:instance>
Nov 09 02:20:21 user nova-compute[75438]:   </metadata>
Nov 09 02:20:21 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:20:21 user nova-compute[75438]:     <system>
Nov 09 02:20:21 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:20:21 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:20:21 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:20:21 user nova-compute[75438]:       <entry name="serial">d287e82e-ad77-45c0-93a2-d0907410ddca</entry>
Nov 09 02:20:21 user nova-compute[75438]:       <entry name="uuid">d287e82e-ad77-45c0-93a2-d0907410ddca</entry>
Nov 09 02:20:21 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:20:21 user nova-compute[75438]:     </system>
Nov 09 02:20:21 user nova-compute[75438]:   </sysinfo>
Nov 09 02:20:21 user nova-compute[75438]:   <os>
Nov 09 02:20:21 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:20:21 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:20:21 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:20:21 user nova-compute[75438]:   </os>
Nov 09 02:20:21 user nova-compute[75438]:   <features>
Nov 09 02:20:21 user nova-compute[75438]:     <acpi/>
Nov 09 02:20:21 user nova-compute[75438]:     <apic/>
Nov 09 02:20:21 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:20:21 user nova-compute[75438]:   </features>
Nov 09 02:20:21 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:20:21 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:20:21 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:20:21 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:20:21 user nova-compute[75438]:   </clock>
Nov 09 02:20:21 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:20:21 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:20:21 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:20:21 user nova-compute[75438]:   </cpu>
Nov 09 02:20:21 user nova-compute[75438]:   <devices>
Nov 09 02:20:21 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:20:21 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:20:21 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk"/>
Nov 09 02:20:21 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:20:21 user nova-compute[75438]:     </disk>
Nov 09 02:20:21 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:20:21 user nova-compute[75438]:       <mac address="fa:16:3e:cd:bb:87"/>
Nov 09 02:20:21 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:20:21 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:20:21 user nova-compute[75438]:       <target dev="tape5b9ebef-90"/>
Nov 09 02:20:21 user nova-compute[75438]:     </interface>
Nov 09 02:20:21 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:20:21 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/console.log" append="off"/>
Nov 09 02:20:21 user nova-compute[75438]:     </serial>
Nov 09 02:20:21 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:20:21 user nova-compute[75438]:     <video>
Nov 09 02:20:21 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:20:21 user nova-compute[75438]:     </video>
Nov 09 02:20:21 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:20:21 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:20:21 user nova-compute[75438]:     </rng>
Nov 09 02:20:21 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:20:21 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:20:21 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:20:21 user nova-compute[75438]:     </memballoon>
Nov 09 02:20:21 user nova-compute[75438]:   </devices>
Nov 09 02:20:21 user nova-compute[75438]: </domain>
Nov 09 02:20:21 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142971782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142971782',id=30,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-o2czctme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:20:20Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=d287e82e-ad77-45c0-93a2-d0907410ddca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG os_vif [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee3e8355-3c59-5cdc-8e4c-861e682a5469', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5b9ebef-90, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5b9ebef-90, col_values=(('qos', UUID('e297bcb4-978d-40e7-9655-4b8065101d0c')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5b9ebef-90, col_values=(('external_ids', {'iface-id': 'e5b9ebef-9096-4d5b-ae91-c0dcbd095b16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:bb:87', 'vm-uuid': 'd287e82e-ad77-45c0-93a2-d0907410ddca'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:22 user nova-compute[75438]: INFO os_vif [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90')
Nov 09 02:20:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No VIF found with MAC fa:16:3e:cd:bb:87, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updated VIF entry in instance network info cache for port e5b9ebef-9096-4d5b-ae91-c0dcbd095b16. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updating instance_info_cache with network_info: [{"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:20:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dbc5f138-ecc0-4d24-8ed0-e3b80e299f09 req-cc8652e1-82e1-4e07-8c20-b54b982e20db service nova] Releasing lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-105de87e-3be6-402d-928a-0c07f8968b45 req-f810032e-7181-4bae-8081-2a0c429bb373 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-105de87e-3be6-402d-928a-0c07f8968b45 req-f810032e-7181-4bae-8081-2a0c429bb373 service nova] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-105de87e-3be6-402d-928a-0c07f8968b45 req-f810032e-7181-4bae-8081-2a0c429bb373 service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-105de87e-3be6-402d-928a-0c07f8968b45 req-f810032e-7181-4bae-8081-2a0c429bb373 service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-105de87e-3be6-402d-928a-0c07f8968b45 req-f810032e-7181-4bae-8081-2a0c429bb373 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] No waiting events found dispatching network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:20:23 user nova-compute[75438]: WARNING nova.compute.manager [req-105de87e-3be6-402d-928a-0c07f8968b45 req-f810032e-7181-4bae-8081-2a0c429bb373 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received unexpected event network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 for instance with vm_state building and task_state spawning.
Nov 09 02:20:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzNCMceG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:20:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:20:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:20:25 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d19b055-6cd7-4f87-a64e-abe5b4cfb1af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:20:25 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[239c33c2-af8f-4a1a-a81a-5f67ce9e42bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e] added
Nov 09 02:20:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9734e9-8883-4dd0-964d-09abbe683b6b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e798eb2-cb66-4e4d-9a39-8e6fd3aefaf8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzNCMceG {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gzNCMceG" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c159283-1ec4-44cc-957e-dfa68ed81fff]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gzNCMceG'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8815f16-9666-41bf-9be4-4486ec01f103]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b17cad-d76d-49dd-8e1a-a06988a646f6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:25 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:20:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:25 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:20:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Instance spawned successfully.
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca1f24f-f7d4-497d-8dab-784d40349101]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260]
Nov 09 02:20:25 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260] successful.
Nov 09 02:20:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[012f9722-a651-4db3-845d-3d15a8456667]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b49d6-bcb5-41c0-908a-3390b3b93cf2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:25 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:20:25 user nova-compute[75438]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)
Nov 09 02:20:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:25 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:20:25 user nova-compute[75438]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)
Nov 09 02:20:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-d2be58b0-53b0-47c7-825e-4c98eb4d2326 req-5bde8837-988c-4cb7-b162-719748528b5c service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d2be58b0-53b0-47c7-825e-4c98eb4d2326 req-5bde8837-988c-4cb7-b162-719748528b5c service nova] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d2be58b0-53b0-47c7-825e-4c98eb4d2326 req-5bde8837-988c-4cb7-b162-719748528b5c service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d2be58b0-53b0-47c7-825e-4c98eb4d2326 req-5bde8837-988c-4cb7-b162-719748528b5c service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-d2be58b0-53b0-47c7-825e-4c98eb4d2326 req-5bde8837-988c-4cb7-b162-719748528b5c service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] No waiting events found dispatching network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:20:25 user nova-compute[75438]: WARNING nova.compute.manager [req-d2be58b0-53b0-47c7-825e-4c98eb4d2326 req-5bde8837-988c-4cb7-b162-719748528b5c service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received unexpected event network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 for instance with vm_state building and task_state spawning.
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[335846da-a439-4a6d-a842-277e1f8d7bda]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:20:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzNCMceG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:20:25 user nova-compute[75438]: INFO nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 09 02:20:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:20:25 user nova-compute[75438]: INFO nova.compute.manager [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Took 6.69 seconds to build instance.
Nov 09 02:20:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4bc85952-6916-49a8-bfe2-b433d4abb4ce tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.798s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:20:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23439623033353431', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:20:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439623033353431', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:20:26 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'flavor' on Instance uuid 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:20:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:20:27 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:20:27 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:20:27 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:20:27 user nova-compute[75438]:   <serial>6e497c27-870d-437b-b6d2-bce25d5cc77e</serial>
Nov 09 02:20:27 user nova-compute[75438]: </disk>
Nov 09 02:20:27 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:20:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:20:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:20:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] No VIF found with MAC fa:16:3e:d2:30:e5, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:20:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d7c88443-2f20-44cf-9aa4-4b66be573635 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.938s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:29 user nova-compute[75438]: INFO nova.compute.manager [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Detaching volume 2f146736-c630-48f4-892f-d4c160677cea
Nov 09 02:20:29 user nova-compute[75438]: INFO nova.virt.block_device [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attempting to driver detach volume 2f146736-c630-48f4-892f-d4c160677cea from mountpoint /dev/vdb
Nov 09 02:20:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Attempting to detach device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:20:29 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:20:29 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:20:29 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:20:29 user nova-compute[75438]:   <serial>2f146736-c630-48f4-892f-d4c160677cea</serial>
Nov 09 02:20:29 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:20:29 user nova-compute[75438]: </disk>
Nov 09 02:20:29 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully detached device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the persistent domain config.
Nov 09 02:20:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:20:29 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:20:29 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:20:29 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:20:29 user nova-compute[75438]:   <serial>2f146736-c630-48f4-892f-d4c160677cea</serial>
Nov 09 02:20:29 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:20:29 user nova-compute[75438]: </disk>
Nov 09 02:20:29 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:20:30 user nova-compute[75438]: INFO nova.compute.manager [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Detaching volume 6e497c27-870d-437b-b6d2-bce25d5cc77e
Nov 09 02:20:30 user nova-compute[75438]: INFO nova.virt.block_device [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Attempting to driver detach volume 6e497c27-870d-437b-b6d2-bce25d5cc77e from mountpoint /dev/vdb
Nov 09 02:20:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Attempting to detach device vdb from instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:20:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:20:30 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:20:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:20:30 user nova-compute[75438]:   <serial>6e497c27-870d-437b-b6d2-bce25d5cc77e</serial>
Nov 09 02:20:30 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:20:30 user nova-compute[75438]: </disk>
Nov 09 02:20:30 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:20:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully detached device vdb from instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 from the persistent domain config.
Nov 09 02:20:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:20:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:20:30 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:20:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:20:30 user nova-compute[75438]:   <serial>6e497c27-870d-437b-b6d2-bce25d5cc77e</serial>
Nov 09 02:20:30 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:20:30 user nova-compute[75438]: </disk>
Nov 09 02:20:30 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:33 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:20:33 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:20:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7805MB free_disk=24.871986389160156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 3be630c7-6913-421f-aa2e-19f3208b12e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:20:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:20:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:20:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:20:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:20:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:39 user nova-compute[75438]: INFO nova.compute.manager [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Terminating instance
Nov 09 02:20:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-992dd624-626d-4c4a-ab85-8345bf7a4eea req-f5ee40fa-e3cc-4493-86b0-11e0e4739916 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-992dd624-626d-4c4a-ab85-8345bf7a4eea req-f5ee40fa-e3cc-4493-86b0-11e0e4739916 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-992dd624-626d-4c4a-ab85-8345bf7a4eea req-f5ee40fa-e3cc-4493-86b0-11e0e4739916 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-992dd624-626d-4c4a-ab85-8345bf7a4eea req-f5ee40fa-e3cc-4493-86b0-11e0e4739916 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-992dd624-626d-4c4a-ab85-8345bf7a4eea req-f5ee40fa-e3cc-4493-86b0-11e0e4739916 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-992dd624-626d-4c4a-ab85-8345bf7a4eea req-f5ee40fa-e3cc-4493-86b0-11e0e4739916 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-unplugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:20:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Instance destroyed successfully.
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lazy-loading 'resources' on Instance uuid 3be630c7-6913-421f-aa2e-19f3208b12e7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:02:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1073959700',display_name='tempest-ServerRescueNegativeTestJSON-server-1073959700',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1073959700',id=2,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:07:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bdfa4af42b4c9796dd143f0c4c3da1',ramdisk_id='',reservation_id='r-7fepwe91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-655487496',owner_user_name='tempest-ServerRescueNegativeTestJSON-655487496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:09:22Z,user_data=None,user_id='ab1818da0f7a44fe8ae3f9ffce360386',uuid=3be630c7-6913-421f-aa2e-19f3208b12e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converting VIF {"id": "451325f5-662e-4cc1-893f-f44ae03ac241", "address": "fa:16:3e:f5:b2:ec", "network": {"id": "c8299279-04b3-4387-affa-a5a091e16add", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1524465739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bdfa4af42b4c9796dd143f0c4c3da1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap451325f5-66", "ovs_interfaceid": "451325f5-662e-4cc1-893f-f44ae03ac241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG os_vif [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap451325f5-66, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ae8d92b-f0dd-44fd-89ac-21e235ce8a86) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:20:40 user nova-compute[75438]: INFO os_vif [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:b2:ec,bridge_name='br-int',has_traffic_filtering=True,id=451325f5-662e-4cc1-893f-f44ae03ac241,network=Network(c8299279-04b3-4387-affa-a5a091e16add),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap451325f5-66')
Nov 09 02:20:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Deleting instance files /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7_del
Nov 09 02:20:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Deletion of /opt/stack/data/nova/instances/3be630c7-6913-421f-aa2e-19f3208b12e7_del complete
Nov 09 02:20:40 user nova-compute[75438]: INFO nova.compute.manager [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 09 02:20:40 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Took 0.55 seconds to deallocate network for instance.
Nov 09 02:20:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-388e1d8a-b453-458b-b0f9-5a6f37d73b97 req-50c3b760-8557-47d6-9008-0b837d1ae81f service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-deleted-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:41 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Deleted allocations for instance 3be630c7-6913-421f-aa2e-19f3208b12e7
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cded938a-9ab1-4ccb-8b6c-1bfa39d8751c tempest-ServerRescueNegativeTestJSON-655487496 tempest-ServerRescueNegativeTestJSON-655487496-project-member] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.175s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:20:41 user nova-compute[75438]: WARNING nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state deleted and task_state None.
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:20:41 user nova-compute[75438]: WARNING nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state deleted and task_state None.
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Acquiring lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] Lock "3be630c7-6913-421f-aa2e-19f3208b12e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] No waiting events found dispatching network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:20:41 user nova-compute[75438]: WARNING nova.compute.manager [req-e69f5e2c-b4b4-4e60-92b9-d557f879929c req-4a8fba1f-2f12-4bb2-bd85-b123de215f01 service nova] [instance: 3be630c7-6913-421f-aa2e-19f3208b12e7] Received unexpected event network-vif-plugged-451325f5-662e-4cc1-893f-f44ae03ac241 for instance with vm_state deleted and task_state None.
Nov 09 02:20:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:20:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:50 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e is timed out.
Nov 09 02:20:50 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully detached device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the live domain config.
Nov 09 02:20:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xYrftJzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:20:50 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05e15e-96ae-4ec5-a90b-23abb0dc7959]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:20:50 user nova-compute[75438]: No targets found.
Nov 09 02:20:50 user nova-compute[75438]: iSNS:
Nov 09 02:20:50 user nova-compute[75438]: No targets found.
Nov 09 02:20:50 user nova-compute[75438]: STATIC:
Nov 09 02:20:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:20:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:20:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:20:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea
Nov 09 02:20:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:20:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:20:50 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e
Nov 09 02:20:50 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:20:50 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:20:50 user nova-compute[75438]: FIRMWARE:
Nov 09 02:20:50 user nova-compute[75438]: No targets found.
Nov 09 02:20:50 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:20:50 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:20:50 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[316847f7-507a-4985-b70f-800ad153d7de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b05232-5848-4bc9-8ed9-ae729b46359d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:50 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:20:50 user nova-compute[75438]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)
Nov 09 02:20:50 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:50 user nova-compute[75438]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea (non-flash)
Nov 09 02:20:50 user nova-compute[75438]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)
Nov 09 02:20:50 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba04417a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c151aabe-347d-4012-82a8-0ece27b6d4cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ff4a0c-b022-4bdc-81e6-6644d8f0fc3b]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd88f63a-f812-4bb2-85d4-53ebe24d24c6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d82fb8-7690-4198-881d-b2992d99d5d3]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b6c3e1-c955-4cd4-b378-7bebafaecc01]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce977088-fa8d-433a-87f5-3062cfada876]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260]
Nov 09 02:20:50 user nova-compute[75438]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea, portal: 172.16.0.220,3260] successful.
Nov 09 02:20:50 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f146736-c630-48f4-892f-d4c160677cea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceadc489-5a38-4678-baf3-8ab3b7172188]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== disconnect_volume: return (345ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:20:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:20:51 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 is timed out.
Nov 09 02:20:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully detached device vdb from instance 4de76ce8-194f-43b7-82b0-1a30c349ab50 from the live domain config.
Nov 09 02:20:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gzNCMceG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:20:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b9a0c-295a-4b9b-994d-f1ae5806300a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:20:51 user nova-compute[75438]: No targets found.
Nov 09 02:20:51 user nova-compute[75438]: iSNS:
Nov 09 02:20:51 user nova-compute[75438]: No targets found.
Nov 09 02:20:51 user nova-compute[75438]: STATIC:
Nov 09 02:20:51 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:20:51 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:20:51 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:20:51 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e
Nov 09 02:20:51 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:20:51 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:20:51 user nova-compute[75438]: FIRMWARE:
Nov 09 02:20:51 user nova-compute[75438]: No targets found.
Nov 09 02:20:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:20:51 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:20:51 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcbd5a-e868-42e7-b77b-8f3b26b8efaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3694140-1634-4de3-acf3-f60b50fea377]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:51 user nova-compute[75438]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)
Nov 09 02:20:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:20:51 user nova-compute[75438]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e (non-flash)
Nov 09 02:20:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba244703a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6552dd28-34cd-40e9-b382-1551a6d0d53b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e09eea7-6966-4784-981a-cecd59ee4575]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f760fa-dad9-4f91-9c43-f5b91cbe0678]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c4c21-a181-4698-af17-c70538f0e070]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4c6ba8-c92c-494a-9b36-321b6fa2e6c2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f680a2b-9fb5-42f5-b3fa-d0553d4a2ee2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260]
Nov 09 02:20:51 user nova-compute[75438]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e, portal: 172.16.0.220,3260] successful.
Nov 09 02:20:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e497c27-870d-437b-b6d2-bce25d5cc77e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9030b064-7d7d-4ccd-adf2-3dde36b51c5b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] <== disconnect_volume: return (328ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:20:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:20:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'flavor' on Instance uuid 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:20:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-ae30a547-ee5c-4c9c-bd4b-7ef0670f5a80 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.386s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:20:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-changed-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Refreshing instance network info cache due to event network-changed-99bc17a1-de88-401d-845f-e12d919a1668. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] Acquiring lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] Acquired lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG nova.network.neutron [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Refreshing network info cache for port 99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG nova.network.neutron [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updated VIF entry in instance network info cache for port 99bc17a1-de88-401d-845f-e12d919a1668. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG nova.network.neutron [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updating instance_info_cache with network_info: [{"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:20:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-92b081ac-3f66-4831-a0e8-712f65f4de50 req-c667c8f5-b27e-4b6c-815d-8fb52f8cafc0 service nova] Releasing lock "refresh_cache-2efbcfcc-01ed-4773-bf45-d72ac07870e8" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:06 user nova-compute[75438]: DEBUG nova.objects.instance [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:21:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-55415991-aa36-4fc6-9d39-27f3cf62a369 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.628s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:09 user nova-compute[75438]: DEBUG nova.objects.instance [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid 2efbcfcc-01ed-4773-bf45-d72ac07870e8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:21:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:10 user nova-compute[75438]: INFO nova.compute.manager [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Attaching volume 9a27e7ac-76cd-43a1-a2b2-eadad81f2150 to /dev/vdb
Nov 09 02:21:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG os_brick.utils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc17352d-8d51-42b4-9c51-7fbf64f8b2c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f30c106-d12f-46d8-b933-ddd04a5a14e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87fb515-8d07-4d56-b82e-3595d527a153]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65d76a8-94e6-4738-a199-d0813564d0b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:21:10 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:21:10 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1360a66b-5436-4906-b895-20b215fc5119]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG os_brick.utils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:21:10 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updating existing volume attachment record: 1225a8f2-411b-4c87-8e88-328cc7e06cba {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:21:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-changed-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Refreshing instance network info cache due to event network-changed-b4a5af82-6853-4d74-98b6-1ee69b313efb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] Acquiring lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] Acquired lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.network.neutron [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Refreshing network info cache for port b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:21 user nova-compute[75438]: INFO nova.compute.manager [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Terminating instance
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6a539ef-04cb-4100-9561-0b1eba238181 req-60431961-70f2-4322-ae70-524a079fba8c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-vif-unplugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6a539ef-04cb-4100-9561-0b1eba238181 req-60431961-70f2-4322-ae70-524a079fba8c service nova] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6a539ef-04cb-4100-9561-0b1eba238181 req-60431961-70f2-4322-ae70-524a079fba8c service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6a539ef-04cb-4100-9561-0b1eba238181 req-60431961-70f2-4322-ae70-524a079fba8c service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6a539ef-04cb-4100-9561-0b1eba238181 req-60431961-70f2-4322-ae70-524a079fba8c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] No waiting events found dispatching network-vif-unplugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6a539ef-04cb-4100-9561-0b1eba238181 req-60431961-70f2-4322-ae70-524a079fba8c service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-vif-unplugged-b4a5af82-6853-4d74-98b6-1ee69b313efb for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updated VIF entry in instance network info cache for port b4a5af82-6853-4d74-98b6-1ee69b313efb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.network.neutron [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updating instance_info_cache with network_info: [{"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-027d78b2-2cf7-41d3-8334-a1584f2ba72a req-5a1b37ac-153c-45ed-8864-c76c11a4d6a9 service nova] Releasing lock "refresh_cache-4de76ce8-194f-43b7-82b0-1a30c349ab50" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Instance destroyed successfully.
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'resources' on Instance uuid 4de76ce8-194f-43b7-82b0-1a30c349ab50 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:18:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255296997',display_name='tempest-TestStampPattern-server-1255296997',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255296997',id=28,image_ref='8dc58bca-7edb-4bf4-babf-47b5ce05bbe5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVAyDRMwjffSqEHQgor1GlyDLaiutN3jGdYixpZry7+mEwIRl0guCFtbKn75XhCI7/ZvTNaQO6Y0hO50K1IkCzCXsM8x/dTz4eGhUYnuIbnYN3L7sdNfCDhQ16Ix2+1ug==',key_name='tempest-TestStampPattern-1748362078',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:18:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af0cb190e1d94289bf11c5544f59f729',ramdisk_id='',reservation_id='r-mwnpto56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='350eb030-6104-46bb-9ffe-da6dcb7244ee',image_min_disk='1',image_min_ram='0',image_owner_id='af0cb190e1d94289bf11c5544f59f729',image_owner_project_name='tempest-TestStampPattern-124162614',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-124162614-project-member',image_user_id='784e9264262a4176839b41cd5d296b94',owner_project_name='tempest-TestStampPattern-124162614',owner_user_name='tempest-TestStampPattern-124162614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:18:15Z,user_data=None,user_id='784e9264262a4176839b41cd5d296b94',uuid=4de76ce8-194f-43b7-82b0-1a30c349ab50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converting VIF {"id": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "address": "fa:16:3e:d2:30:e5", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4a5af82-68", "ovs_interfaceid": "b4a5af82-6853-4d74-98b6-1ee69b313efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG os_vif [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4a5af82-68, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5e34fba3-8226-45af-907f-a3518e9112e3) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:22 user nova-compute[75438]: INFO os_vif [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:30:e5,bridge_name='br-int',has_traffic_filtering=True,id=b4a5af82-6853-4d74-98b6-1ee69b313efb,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4a5af82-68')
Nov 09 02:21:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Deleting instance files /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50_del
Nov 09 02:21:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Deletion of /opt/stack/data/nova/instances/4de76ce8-194f-43b7-82b0-1a30c349ab50_del complete
Nov 09 02:21:22 user nova-compute[75438]: INFO nova.compute.manager [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 09 02:21:22 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:22 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Took 0.52 seconds to deallocate network for instance.
Nov 09 02:21:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-05572e4c-d8d7-4243-b50f-10092587ba07 req-12233d00-270c-43b2-809a-9f6affb55897 service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-vif-deleted-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:23 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Deleted allocations for instance 4de76ce8-194f-43b7-82b0-1a30c349ab50
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0e1a152b-1ec7-4489-aa7d-9b4eac103a8f tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.212s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-625b97b4-0a33-4956-8087-e893911ed98f req-3fc746f0-a819-4adf-88d9-81dfdaec536b service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received event network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-625b97b4-0a33-4956-8087-e893911ed98f req-3fc746f0-a819-4adf-88d9-81dfdaec536b service nova] Acquiring lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-625b97b4-0a33-4956-8087-e893911ed98f req-3fc746f0-a819-4adf-88d9-81dfdaec536b service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-625b97b4-0a33-4956-8087-e893911ed98f req-3fc746f0-a819-4adf-88d9-81dfdaec536b service nova] Lock "4de76ce8-194f-43b7-82b0-1a30c349ab50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-625b97b4-0a33-4956-8087-e893911ed98f req-3fc746f0-a819-4adf-88d9-81dfdaec536b service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] No waiting events found dispatching network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:21:23 user nova-compute[75438]: WARNING nova.compute.manager [req-625b97b4-0a33-4956-8087-e893911ed98f req-3fc746f0-a819-4adf-88d9-81dfdaec536b service nova] [instance: 4de76ce8-194f-43b7-82b0-1a30c349ab50] Received unexpected event network-vif-plugged-b4a5af82-6853-4d74-98b6-1ee69b313efb for instance with vm_state deleted and task_state None.
Nov 09 02:21:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.186s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:27 user nova-compute[75438]: INFO nova.compute.manager [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attaching volume 7ee75d3c-16d9-42d2-99b7-e258e5ba1066 to /dev/vdb
Nov 09 02:21:27 user nova-compute[75438]: DEBUG os_brick.utils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d3164-8aa6-4ba4-b172-ce71bf4cdabf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1832a4-feef-44d3-adbf-a65bb3a1fe8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[056452b7-d223-40d1-9376-2588449a42bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e6e64-4def-4b99-a2fb-fd2fbf250688]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:21:28 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:21:28 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a7ab7-abdb-4a5e-bc1b-cb9afb2ab88b]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG os_brick.utils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:21:28 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating existing volume attachment record: 34b686c3-e695-4662-a75b-29e1f415539c {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:21:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:29 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:33 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:21:33 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=24.850906372070312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:21:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:21:35 user nova-compute[75438]: INFO nova.compute.claims [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Claim successful on node user
Nov 09 02:21:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:21:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.policy [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e95d2465b0af4dcab397b5ccc2809c59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a4b29710bb14b8fb9714109aec43dc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:21:36 user nova-compute[75438]: INFO nova.virt.block_device [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Booting with volume c58efce2-07e1-4947-b9fe-94da4ddc6a2f at /dev/vda
Nov 09 02:21:36 user nova-compute[75438]: DEBUG os_brick.utils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c3d11-cf09-4257-bde9-e27b6c5401a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[206e4e58-3370-4ee6-acfc-057d0240d8c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[69029784-b9ba-480f-b7dd-cbf5698c6503]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e66e235-272c-404a-9ddd-822987d99e13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:21:37 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a1e36a-a398-4ff3-ace0-2efd70b1d168]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.utils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating existing volume attachment record: 9c229fb0-d186-4e9e-b85e-baec5753376f {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Successfully created port: 44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNbMzjaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:21:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:21:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:21:37 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6811487d-00e1-4675-acf7-1ffdd09ed002]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:21:37 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a4a999-f196-485a-ab66-5cbbf69c4866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150] added
Nov 09 02:21:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e0711-7eca-4b12-b4ac-eb832e03480c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96929fd-9b15-4138-b510-a594965bc87b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNbMzjaK {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNbMzjaK" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c2fea4-e4cb-4b61-94b0-1a1ad98f67df]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNbMzjaK'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36a7108-7b07-4529-9ea0-a63b7eab5119]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[da21e64c-dab7-4b20-b99d-69be0c87f201]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:21:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:21:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[00466864-3e96-4d9d-ae47-ad1e4002146f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260]
Nov 09 02:21:37 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260] successful.
Nov 09 02:21:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d9e0bc-99ca-46cd-a189-ccf541ed7e5f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c48753-14b3-4768-8640-6198ab7ba373]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:21:37 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:21:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:21:37 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:21:37 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:21:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249f482-8f8c-4f2e-8708-d354471a8aed]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNbMzjaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Successfully updated port: 44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquired lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-changed-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Refreshing instance network info cache due to event network-changed-44e587c3-eb25-4da8-b054-5439a13ebf51. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] Acquiring lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Releasing lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance network_info: |[{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] Acquired lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:21:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Refreshing network info cache for port 44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26133636136303766', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133636136303766', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid 2efbcfcc-01ed-4773-bf45-d72ac07870e8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:21:39 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:21:39 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:21:39 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:21:39 user nova-compute[75438]:   <serial>9a27e7ac-76cd-43a1-a2b2-eadad81f2150</serial>
Nov 09 02:21:39 user nova-compute[75438]: </disk>
Nov 09 02:21:39 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:db:78:11, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8b45b6d6-3290-4295-87db-04b338540034 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.594s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updated VIF entry in instance network info cache for port 44e587c3-eb25-4da8-b054-5439a13ebf51. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG nova.network.neutron [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a6e11ef1-68e4-41c9-ad01-2736e1f8cc95 req-aac7e3a7-2592-40f0-baad-d4835f3e4d1b service nova] Releasing lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:21:44 user nova-compute[75438]: INFO nova.compute.claims [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Claim successful on node user
Nov 09 02:21:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:21:44 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.network.neutron [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:21:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.policy [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f241dbd509b4beb8148222f8379d58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374722030e844844b670f169c722977c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:21:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Creating image(s)
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.212s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk 1073741824" returned: 0 in 0.074s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.279s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Successfully created port: fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Cannot resize image /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Ensure instance console log exists: /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Successfully updated port: fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquired lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-changed-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Refreshing instance network info cache due to event network-changed-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] Acquiring lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updating instance_info_cache with network_info: [{"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Releasing lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Instance network_info: |[{"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] Acquired lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Refreshing network info cache for port fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Start _get_guest_xml network_info=[{"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:21:47 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:21:47 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1602786864',display_name='tempest-AttachVolumeNegativeTest-server-1602786864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1602786864',id=32,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlIpZaBKPflVlcRgXFZqIyP2ZGG0+Z7Uunhp4MsVJmm8vcOR54cOzdv/iPxI59/fJFZAxlMJ0KfM2ftn8TNRkqCLdEAXFS+EGezmMdO1TKKSkpQlhobtazZpjO1KLGk8Q==',key_name='tempest-keypair-1245155042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-erwnbhse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=ab57b224-59ec-4344-a0cc-515d59a3810c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.objects.instance [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'pci_devices' on Instance uuid ab57b224-59ec-4344-a0cc-515d59a3810c {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:21:47 user nova-compute[75438]:   <uuid>ab57b224-59ec-4344-a0cc-515d59a3810c</uuid>
Nov 09 02:21:47 user nova-compute[75438]:   <name>instance-00000020</name>
Nov 09 02:21:47 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:21:47 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:21:47 user nova-compute[75438]:   <metadata>
Nov 09 02:21:47 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:21:47 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:21:47 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1602786864</nova:name>
Nov 09 02:21:47 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:21:47</nova:creationTime>
Nov 09 02:21:47 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:21:47 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:21:47 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:21:47 user nova-compute[75438]:       <nova:owner>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:user uuid="1f241dbd509b4beb8148222f8379d58e">tempest-AttachVolumeNegativeTest-1037659816-project-member</nova:user>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:project uuid="374722030e844844b670f169c722977c">tempest-AttachVolumeNegativeTest-1037659816</nova:project>
Nov 09 02:21:47 user nova-compute[75438]:       </nova:owner>
Nov 09 02:21:47 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:21:47 user nova-compute[75438]:       <nova:ports>
Nov 09 02:21:47 user nova-compute[75438]:         <nova:port uuid="fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9">
Nov 09 02:21:47 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:21:47 user nova-compute[75438]:         </nova:port>
Nov 09 02:21:47 user nova-compute[75438]:       </nova:ports>
Nov 09 02:21:47 user nova-compute[75438]:     </nova:instance>
Nov 09 02:21:47 user nova-compute[75438]:   </metadata>
Nov 09 02:21:47 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:21:47 user nova-compute[75438]:     <system>
Nov 09 02:21:47 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:21:47 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:21:47 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:21:47 user nova-compute[75438]:       <entry name="serial">ab57b224-59ec-4344-a0cc-515d59a3810c</entry>
Nov 09 02:21:47 user nova-compute[75438]:       <entry name="uuid">ab57b224-59ec-4344-a0cc-515d59a3810c</entry>
Nov 09 02:21:47 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:21:47 user nova-compute[75438]:     </system>
Nov 09 02:21:47 user nova-compute[75438]:   </sysinfo>
Nov 09 02:21:47 user nova-compute[75438]:   <os>
Nov 09 02:21:47 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:21:47 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:21:47 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:21:47 user nova-compute[75438]:   </os>
Nov 09 02:21:47 user nova-compute[75438]:   <features>
Nov 09 02:21:47 user nova-compute[75438]:     <acpi/>
Nov 09 02:21:47 user nova-compute[75438]:     <apic/>
Nov 09 02:21:47 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:21:47 user nova-compute[75438]:   </features>
Nov 09 02:21:47 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:21:47 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:21:47 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:21:47 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:21:47 user nova-compute[75438]:   </clock>
Nov 09 02:21:47 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:21:47 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:21:47 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:21:47 user nova-compute[75438]:   </cpu>
Nov 09 02:21:47 user nova-compute[75438]:   <devices>
Nov 09 02:21:47 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:21:47 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:21:47 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk"/>
Nov 09 02:21:47 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:21:47 user nova-compute[75438]:     </disk>
Nov 09 02:21:47 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:21:47 user nova-compute[75438]:       <mac address="fa:16:3e:1c:87:b9"/>
Nov 09 02:21:47 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:21:47 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:21:47 user nova-compute[75438]:       <target dev="tapfd89000c-d9"/>
Nov 09 02:21:47 user nova-compute[75438]:     </interface>
Nov 09 02:21:47 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:21:47 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/console.log" append="off"/>
Nov 09 02:21:47 user nova-compute[75438]:     </serial>
Nov 09 02:21:47 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:21:47 user nova-compute[75438]:     <video>
Nov 09 02:21:47 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:21:47 user nova-compute[75438]:     </video>
Nov 09 02:21:47 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:21:47 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:21:47 user nova-compute[75438]:     </rng>
Nov 09 02:21:47 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:21:47 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:21:47 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:21:47 user nova-compute[75438]:     </memballoon>
Nov 09 02:21:47 user nova-compute[75438]:   </devices>
Nov 09 02:21:47 user nova-compute[75438]: </domain>
Nov 09 02:21:47 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1602786864',display_name='tempest-AttachVolumeNegativeTest-server-1602786864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1602786864',id=32,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlIpZaBKPflVlcRgXFZqIyP2ZGG0+Z7Uunhp4MsVJmm8vcOR54cOzdv/iPxI59/fJFZAxlMJ0KfM2ftn8TNRkqCLdEAXFS+EGezmMdO1TKKSkpQlhobtazZpjO1KLGk8Q==',key_name='tempest-keypair-1245155042',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-erwnbhse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:21:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=ab57b224-59ec-4344-a0cc-515d59a3810c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG os_vif [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4353d3c-8e04-501b-9348-c44d8ff81394', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd89000c-d9, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd89000c-d9, col_values=(('qos', UUID('95eca8a8-d9c9-4def-933b-917158a313e2')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd89000c-d9, col_values=(('external_ids', {'iface-id': 'fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:87:b9', 'vm-uuid': 'ab57b224-59ec-4344-a0cc-515d59a3810c'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:47 user nova-compute[75438]: INFO os_vif [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9')
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:1c:87:b9, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updated VIF entry in instance network info cache for port fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:21:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updating instance_info_cache with network_info: [{"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:21:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3b2c78bf-1892-4371-b018-3b2741a22250 req-2311dd91-f749-46c9-a315-f4b2a400069a service nova] Releasing lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-a51cc01f-54a2-4041-baae-83d2b213ef0a req-db52a123-2095-479b-83be-128732143e41 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a51cc01f-54a2-4041-baae-83d2b213ef0a req-db52a123-2095-479b-83be-128732143e41 service nova] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a51cc01f-54a2-4041-baae-83d2b213ef0a req-db52a123-2095-479b-83be-128732143e41 service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a51cc01f-54a2-4041-baae-83d2b213ef0a req-db52a123-2095-479b-83be-128732143e41 service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-a51cc01f-54a2-4041-baae-83d2b213ef0a req-db52a123-2095-479b-83be-128732143e41 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] No waiting events found dispatching network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:21:49 user nova-compute[75438]: WARNING nova.compute.manager [req-a51cc01f-54a2-4041-baae-83d2b213ef0a req-db52a123-2095-479b-83be-128732143e41 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received unexpected event network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 for instance with vm_state building and task_state spawning.
Nov 09 02:21:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-a345576a-0ede-4382-b4aa-d28cb5e9667d req-5ba375fc-862d-4f46-95f1-d10a263ad6eb service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a345576a-0ede-4382-b4aa-d28cb5e9667d req-5ba375fc-862d-4f46-95f1-d10a263ad6eb service nova] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a345576a-0ede-4382-b4aa-d28cb5e9667d req-5ba375fc-862d-4f46-95f1-d10a263ad6eb service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a345576a-0ede-4382-b4aa-d28cb5e9667d req-5ba375fc-862d-4f46-95f1-d10a263ad6eb service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-a345576a-0ede-4382-b4aa-d28cb5e9667d req-5ba375fc-862d-4f46-95f1-d10a263ad6eb service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] No waiting events found dispatching network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:21:51 user nova-compute[75438]: WARNING nova.compute.manager [req-a345576a-0ede-4382-b4aa-d28cb5e9667d req-5ba375fc-862d-4f46-95f1-d10a263ad6eb service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received unexpected event network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 for instance with vm_state building and task_state spawning.
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:21:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Instance spawned successfully.
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:21:51 user nova-compute[75438]: INFO nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 09 02:21:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:21:51 user nova-compute[75438]: INFO nova.compute.manager [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Took 7.51 seconds to build instance.
Nov 09 02:21:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8dc520c4-150a-4993-a84a-2d916dc53da5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.641s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:21:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:21:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJTfCzDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:22:00 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:22:00 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:22:00 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba810d-b2ce-4186-afb1-20d697f5f9b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:22:00 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62693522-1fa9-4c20-b323-8929a95a469b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066] added
Nov 09 02:22:00 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c655f-2ca3-462d-bb60-4d7189e57555]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[132d2444-e0ca-45b5-ab55-1b31b8683f12]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJTfCzDj {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IJTfCzDj" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f803ac-4863-44d7-a635-f6625ab9040a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IJTfCzDj'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897f0b1-0730-460a-be45-93bfdb2355bc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[68082537-4d34-4457-8c80-8ba5073988cf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6220dab-b3cb-4067-9a6b-43f1db606021]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260]
Nov 09 02:22:01 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260] successful.
Nov 09 02:22:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ca1d7b-c705-4c0e-8f6c-056b9262605a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f739f6f-bfdf-4dcc-b699-2357888bd2fa]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 (non-flash)
Nov 09 02:22:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5b3c5f-91d8-4d6b-8df6-0cfddf82e506]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:22:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJTfCzDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:22:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:22:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== connect_volume: return (1501ms) {'type': 'block', 'scsi_wwn': '26237373063616435', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:22:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237373063616435', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:22:02 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:22:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:22:02 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:22:02 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:22:02 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:22:02 user nova-compute[75438]:   <serial>7ee75d3c-16d9-42d2-99b7-e258e5ba1066</serial>
Nov 09 02:22:02 user nova-compute[75438]: </disk>
Nov 09 02:22:02 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:22:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:22:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:22:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No VIF found with MAC fa:16:3e:03:d7:69, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:22:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d86d81ba-e640-48fb-a624-826ece224d12 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.364s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:05 user nova-compute[75438]: INFO nova.compute.manager [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Detaching volume 7ee75d3c-16d9-42d2-99b7-e258e5ba1066
Nov 09 02:22:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:05 user nova-compute[75438]: INFO nova.virt.block_device [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attempting to driver detach volume 7ee75d3c-16d9-42d2-99b7-e258e5ba1066 from mountpoint /dev/vdb
Nov 09 02:22:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Attempting to detach device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:22:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:22:05 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:22:05 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:22:05 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:22:05 user nova-compute[75438]:   <serial>7ee75d3c-16d9-42d2-99b7-e258e5ba1066</serial>
Nov 09 02:22:05 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:22:05 user nova-compute[75438]: </disk>
Nov 09 02:22:05 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:22:05 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully detached device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the persistent domain config.
Nov 09 02:22:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:22:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:22:05 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:22:05 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:22:05 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:22:05 user nova-compute[75438]:   <serial>7ee75d3c-16d9-42d2-99b7-e258e5ba1066</serial>
Nov 09 02:22:05 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:22:05 user nova-compute[75438]: </disk>
Nov 09 02:22:05 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:06 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:22:06 user nova-compute[75438]: INFO nova.compute.claims [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Claim successful on node user
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:22:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.policy [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '379247c2ddac45cca6c36c7683e2f811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18f0ec2f816d4c7bb8c29bc5987f73d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:22:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Creating image(s)
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "/opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "/opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "/opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk 1073741824" returned: 0 in 0.068s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Successfully created port: e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Cannot resize image /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Ensure instance console log exists: /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Successfully updated port: e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquired lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-changed-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Refreshing instance network info cache due to event network-changed-e3d094d5-d281-4ef3-a491-9e87a7c50d2a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] Acquiring lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updating instance_info_cache with network_info: [{"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Releasing lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Instance network_info: |[{"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] Acquired lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.neutron [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Refreshing network info cache for port e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Start _get_guest_xml network_info=[{"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:22:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:22:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2983357',id=33,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6gsZJswzoWOXEdmk289ffSmtPiJKNZba0nKih1GKsMEgpVe6qN0QbO6nvrUzXeCsWUUiovIq18HNMzWPpCRox5LB0b4QcV6YPI1Nf1E+Nz2EycNuPyItusgM0WmR/SOA==',key_name='tempest-keypair-1739225489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f0ec2f816d4c7bb8c29bc5987f73d9',ramdisk_id='',reservation_id='r-iy2s79a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1794109058',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='379247c2ddac45cca6c36c7683e2f811',uuid=67e53684-8b40-4255-99a7-bfef8e644c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Converting VIF {"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.objects.instance [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lazy-loading 'pci_devices' on Instance uuid 67e53684-8b40-4255-99a7-bfef8e644c04 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:22:09 user nova-compute[75438]:   <uuid>67e53684-8b40-4255-99a7-bfef8e644c04</uuid>
Nov 09 02:22:09 user nova-compute[75438]:   <name>instance-00000021</name>
Nov 09 02:22:09 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:22:09 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:22:09 user nova-compute[75438]:   <metadata>
Nov 09 02:22:09 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:22:09 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:22:09 user nova-compute[75438]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707</nova:name>
Nov 09 02:22:09 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:22:09</nova:creationTime>
Nov 09 02:22:09 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:22:09 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:22:09 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:22:09 user nova-compute[75438]:       <nova:owner>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:user uuid="379247c2ddac45cca6c36c7683e2f811">tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member</nova:user>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:project uuid="18f0ec2f816d4c7bb8c29bc5987f73d9">tempest-TestServerVolumeAttachScenarioOldVersion-1794109058</nova:project>
Nov 09 02:22:09 user nova-compute[75438]:       </nova:owner>
Nov 09 02:22:09 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:22:09 user nova-compute[75438]:       <nova:ports>
Nov 09 02:22:09 user nova-compute[75438]:         <nova:port uuid="e3d094d5-d281-4ef3-a491-9e87a7c50d2a">
Nov 09 02:22:09 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:22:09 user nova-compute[75438]:         </nova:port>
Nov 09 02:22:09 user nova-compute[75438]:       </nova:ports>
Nov 09 02:22:09 user nova-compute[75438]:     </nova:instance>
Nov 09 02:22:09 user nova-compute[75438]:   </metadata>
Nov 09 02:22:09 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:22:09 user nova-compute[75438]:     <system>
Nov 09 02:22:09 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:22:09 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:22:09 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:22:09 user nova-compute[75438]:       <entry name="serial">67e53684-8b40-4255-99a7-bfef8e644c04</entry>
Nov 09 02:22:09 user nova-compute[75438]:       <entry name="uuid">67e53684-8b40-4255-99a7-bfef8e644c04</entry>
Nov 09 02:22:09 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:22:09 user nova-compute[75438]:     </system>
Nov 09 02:22:09 user nova-compute[75438]:   </sysinfo>
Nov 09 02:22:09 user nova-compute[75438]:   <os>
Nov 09 02:22:09 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:22:09 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:22:09 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:22:09 user nova-compute[75438]:   </os>
Nov 09 02:22:09 user nova-compute[75438]:   <features>
Nov 09 02:22:09 user nova-compute[75438]:     <acpi/>
Nov 09 02:22:09 user nova-compute[75438]:     <apic/>
Nov 09 02:22:09 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:22:09 user nova-compute[75438]:   </features>
Nov 09 02:22:09 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:22:09 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:22:09 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:22:09 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:22:09 user nova-compute[75438]:   </clock>
Nov 09 02:22:09 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:22:09 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:22:09 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:22:09 user nova-compute[75438]:   </cpu>
Nov 09 02:22:09 user nova-compute[75438]:   <devices>
Nov 09 02:22:09 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:22:09 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:22:09 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk"/>
Nov 09 02:22:09 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:22:09 user nova-compute[75438]:     </disk>
Nov 09 02:22:09 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:22:09 user nova-compute[75438]:       <mac address="fa:16:3e:ca:ed:c4"/>
Nov 09 02:22:09 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:22:09 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:22:09 user nova-compute[75438]:       <target dev="tape3d094d5-d2"/>
Nov 09 02:22:09 user nova-compute[75438]:     </interface>
Nov 09 02:22:09 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:22:09 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/console.log" append="off"/>
Nov 09 02:22:09 user nova-compute[75438]:     </serial>
Nov 09 02:22:09 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:22:09 user nova-compute[75438]:     <video>
Nov 09 02:22:09 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:22:09 user nova-compute[75438]:     </video>
Nov 09 02:22:09 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:22:09 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:22:09 user nova-compute[75438]:     </rng>
Nov 09 02:22:09 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:22:09 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:22:09 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:22:09 user nova-compute[75438]:     </memballoon>
Nov 09 02:22:09 user nova-compute[75438]:   </devices>
Nov 09 02:22:09 user nova-compute[75438]: </domain>
Nov 09 02:22:09 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2983357',id=33,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6gsZJswzoWOXEdmk289ffSmtPiJKNZba0nKih1GKsMEgpVe6qN0QbO6nvrUzXeCsWUUiovIq18HNMzWPpCRox5LB0b4QcV6YPI1Nf1E+Nz2EycNuPyItusgM0WmR/SOA==',key_name='tempest-keypair-1739225489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18f0ec2f816d4c7bb8c29bc5987f73d9',ramdisk_id='',reservation_id='r-iy2s79a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1794109058',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='379247c2ddac45cca6c36c7683e2f811',uuid=67e53684-8b40-4255-99a7-bfef8e644c04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Converting VIF {"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG os_vif [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f32fd901-3ca9-5d36-8253-4344910455c5', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3d094d5-d2, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3d094d5-d2, col_values=(('qos', UUID('6a61d118-898a-4999-9b9c-0231bfbb818d')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3d094d5-d2, col_values=(('external_ids', {'iface-id': 'e3d094d5-d281-4ef3-a491-9e87a7c50d2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:ed:c4', 'vm-uuid': '67e53684-8b40-4255-99a7-bfef8e644c04'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:09 user nova-compute[75438]: INFO os_vif [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2')
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:22:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] No VIF found with MAC fa:16:3e:ca:ed:c4, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:22:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updated VIF entry in instance network info cache for port e3d094d5-d281-4ef3-a491-9e87a7c50d2a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:22:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updating instance_info_cache with network_info: [{"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-40a5600d-0fd2-4914-8c80-cd40952fde80 req-43f36392-9b31-4494-87de-67cf2290c41f service nova] Releasing lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:22:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:22:10 user nova-compute[75438]: INFO nova.compute.manager [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] instance snapshotting
Nov 09 02:22:10 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Beginning live snapshot process
Nov 09 02:22:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json -f qcow2" returned: 0 in 0.230s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json -f qcow2 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-7a04d6d7-066e-4005-8987-7dbf47767a43 req-25678912-e362-4cf2-b3a2-cc3cc639cacc service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a04d6d7-066e-4005-8987-7dbf47767a43 req-25678912-e362-4cf2-b3a2-cc3cc639cacc service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a04d6d7-066e-4005-8987-7dbf47767a43 req-25678912-e362-4cf2-b3a2-cc3cc639cacc service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7a04d6d7-066e-4005-8987-7dbf47767a43 req-25678912-e362-4cf2-b3a2-cc3cc639cacc service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-7a04d6d7-066e-4005-8987-7dbf47767a43 req-25678912-e362-4cf2-b3a2-cc3cc639cacc service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:11 user nova-compute[75438]: WARNING nova.compute.manager [req-7a04d6d7-066e-4005-8987-7dbf47767a43 req-25678912-e362-4cf2-b3a2-cc3cc639cacc service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state building and task_state spawning.
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.222s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfeivg2wn/e74076be456b486b95689be72b9ef851.delta 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfeivg2wn/e74076be456b486b95689be72b9ef851.delta 1073741824" returned: 0 in 0.056s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 09 02:22:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:22:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75438) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 09 02:22:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfeivg2wn/e74076be456b486b95689be72b9ef851.delta /opt/stack/data/nova/instances/snapshots/tmpfeivg2wn/e74076be456b486b95689be72b9ef851 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:22:13 user nova-compute[75438]: INFO nova.compute.claims [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Claim successful on node user
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69d0d86-5694-4489-acdb-7a77f2a5cc03 req-e3b08ab4-402e-4390-b242-a3341df7717e service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69d0d86-5694-4489-acdb-7a77f2a5cc03 req-e3b08ab4-402e-4390-b242-a3341df7717e service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69d0d86-5694-4489-acdb-7a77f2a5cc03 req-e3b08ab4-402e-4390-b242-a3341df7717e service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e69d0d86-5694-4489-acdb-7a77f2a5cc03 req-e3b08ab4-402e-4390-b242-a3341df7717e service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-e69d0d86-5694-4489-acdb-7a77f2a5cc03 req-e3b08ab4-402e-4390-b242-a3341df7717e service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:13 user nova-compute[75438]: WARNING nova.compute.manager [req-e69d0d86-5694-4489-acdb-7a77f2a5cc03 req-e3b08ab4-402e-4390-b242-a3341df7717e service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state building and task_state spawning.
Nov 09 02:22:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfeivg2wn/e74076be456b486b95689be72b9ef851.delta /opt/stack/data/nova/instances/snapshots/tmpfeivg2wn/e74076be456b486b95689be72b9ef851" returned: 0 in 0.363s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:13 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Snapshot extracted, beginning image upload
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:22:13 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Instance spawned successfully.
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:13 user nova-compute[75438]: INFO nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 09 02:22:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:22:14 user nova-compute[75438]: INFO nova.compute.manager [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Took 7.39 seconds to build instance.
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.755s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-603c0542-cdb8-4aad-b6a5-a164f8265091 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.521s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:22:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:22:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Creating image(s)
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "/opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "/opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG nova.policy [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60a216aff05344cbbc74ba03e8f7999e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcd1d351887b435ab410721ef8450f39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.237s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk 1073741824" returned: 0 in 0.059s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.259s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Successfully created port: 0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Cannot resize image /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Ensure instance console log exists: /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Successfully updated port: 0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "refresh_cache-4ae460b2-d469-429b-9071-28f8b560bfbd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquired lock "refresh_cache-4ae460b2-d469-429b-9071-28f8b560bfbd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-changed-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Refreshing instance network info cache due to event network-changed-0445211d-6749-4343-8d64-682d8e3233ab. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] Acquiring lock "refresh_cache-4ae460b2-d469-429b-9071-28f8b560bfbd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.neutron [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Updating instance_info_cache with network_info: [{"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Releasing lock "refresh_cache-4ae460b2-d469-429b-9071-28f8b560bfbd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Instance network_info: |[{"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] Acquired lock "refresh_cache-4ae460b2-d469-429b-9071-28f8b560bfbd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.neutron [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Refreshing network info cache for port 0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Start _get_guest_xml network_info=[{"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:22:16 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:22:16 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-182581968',display_name='tempest-VolumesNegativeTest-instance-182581968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-182581968',id=34,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd1d351887b435ab410721ef8450f39',ramdisk_id='',reservation_id='r-46bicnn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1057879860',owner_user_name='tempest-VolumesNegativeTest-1057879860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:22:14Z,user_data=None,user_id='60a216aff05344cbbc74ba03e8f7999e',uuid=4ae460b2-d469-429b-9071-28f8b560bfbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Converting VIF {"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ae460b2-d469-429b-9071-28f8b560bfbd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:22:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Snapshot image upload complete
Nov 09 02:22:16 user nova-compute[75438]: INFO nova.compute.manager [None req-88ff504b-cbb9-480e-9dc8-5c0d780be1c7 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Took 6.26 seconds to snapshot the instance on the hypervisor.
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:22:16 user nova-compute[75438]:   <uuid>4ae460b2-d469-429b-9071-28f8b560bfbd</uuid>
Nov 09 02:22:16 user nova-compute[75438]:   <name>instance-00000022</name>
Nov 09 02:22:16 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:22:16 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:22:16 user nova-compute[75438]:   <metadata>
Nov 09 02:22:16 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:22:16 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:22:16 user nova-compute[75438]:       <nova:name>tempest-VolumesNegativeTest-instance-182581968</nova:name>
Nov 09 02:22:16 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:22:16</nova:creationTime>
Nov 09 02:22:16 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:22:16 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:22:16 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:22:16 user nova-compute[75438]:       <nova:owner>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:user uuid="60a216aff05344cbbc74ba03e8f7999e">tempest-VolumesNegativeTest-1057879860-project-member</nova:user>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:project uuid="bcd1d351887b435ab410721ef8450f39">tempest-VolumesNegativeTest-1057879860</nova:project>
Nov 09 02:22:16 user nova-compute[75438]:       </nova:owner>
Nov 09 02:22:16 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:22:16 user nova-compute[75438]:       <nova:ports>
Nov 09 02:22:16 user nova-compute[75438]:         <nova:port uuid="0445211d-6749-4343-8d64-682d8e3233ab">
Nov 09 02:22:16 user nova-compute[75438]:           <nova:ip type="fixed" address="192.168.233.236" ipVersion="4"/>
Nov 09 02:22:16 user nova-compute[75438]:         </nova:port>
Nov 09 02:22:16 user nova-compute[75438]:       </nova:ports>
Nov 09 02:22:16 user nova-compute[75438]:     </nova:instance>
Nov 09 02:22:16 user nova-compute[75438]:   </metadata>
Nov 09 02:22:16 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:22:16 user nova-compute[75438]:     <system>
Nov 09 02:22:16 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:22:16 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:22:16 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:22:16 user nova-compute[75438]:       <entry name="serial">4ae460b2-d469-429b-9071-28f8b560bfbd</entry>
Nov 09 02:22:16 user nova-compute[75438]:       <entry name="uuid">4ae460b2-d469-429b-9071-28f8b560bfbd</entry>
Nov 09 02:22:16 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:22:16 user nova-compute[75438]:     </system>
Nov 09 02:22:16 user nova-compute[75438]:   </sysinfo>
Nov 09 02:22:16 user nova-compute[75438]:   <os>
Nov 09 02:22:16 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:22:16 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:22:16 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:22:16 user nova-compute[75438]:   </os>
Nov 09 02:22:16 user nova-compute[75438]:   <features>
Nov 09 02:22:16 user nova-compute[75438]:     <acpi/>
Nov 09 02:22:16 user nova-compute[75438]:     <apic/>
Nov 09 02:22:16 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:22:16 user nova-compute[75438]:   </features>
Nov 09 02:22:16 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:22:16 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:22:16 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:22:16 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:22:16 user nova-compute[75438]:   </clock>
Nov 09 02:22:16 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:22:16 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:22:16 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:22:16 user nova-compute[75438]:   </cpu>
Nov 09 02:22:16 user nova-compute[75438]:   <devices>
Nov 09 02:22:16 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:22:16 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:22:16 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk"/>
Nov 09 02:22:16 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:22:16 user nova-compute[75438]:     </disk>
Nov 09 02:22:16 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:22:16 user nova-compute[75438]:       <mac address="fa:16:3e:c0:e9:c8"/>
Nov 09 02:22:16 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:22:16 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:22:16 user nova-compute[75438]:       <target dev="tap0445211d-67"/>
Nov 09 02:22:16 user nova-compute[75438]:     </interface>
Nov 09 02:22:16 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:22:16 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/console.log" append="off"/>
Nov 09 02:22:16 user nova-compute[75438]:     </serial>
Nov 09 02:22:16 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:22:16 user nova-compute[75438]:     <video>
Nov 09 02:22:16 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:22:16 user nova-compute[75438]:     </video>
Nov 09 02:22:16 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:22:16 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:22:16 user nova-compute[75438]:     </rng>
Nov 09 02:22:16 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:22:16 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:22:16 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:22:16 user nova-compute[75438]:     </memballoon>
Nov 09 02:22:16 user nova-compute[75438]:   </devices>
Nov 09 02:22:16 user nova-compute[75438]: </domain>
Nov 09 02:22:16 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-182581968',display_name='tempest-VolumesNegativeTest-instance-182581968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-182581968',id=34,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bcd1d351887b435ab410721ef8450f39',ramdisk_id='',reservation_id='r-46bicnn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1057879860',owner_user_name='tempest-VolumesNegativeTest-1057879860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:22:14Z,user_data=None,user_id='60a216aff05344cbbc74ba03e8f7999e',uuid=4ae460b2-d469-429b-9071-28f8b560bfbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Converting VIF {"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG os_vif [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf91ed02-cd93-5c63-b8a4-d559b4b4e520', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0445211d-67, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0445211d-67, col_values=(('qos', UUID('ab4ee809-00c4-4ee8-9083-80f50423b101')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0445211d-67, col_values=(('external_ids', {'iface-id': '0445211d-6749-4343-8d64-682d8e3233ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:e9:c8', 'vm-uuid': '4ae460b2-d469-429b-9071-28f8b560bfbd'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:22:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:17 user nova-compute[75438]: INFO os_vif [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67')
Nov 09 02:22:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:22:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] No VIF found with MAC fa:16:3e:c0:e9:c8, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:22:17 user nova-compute[75438]: DEBUG nova.network.neutron [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Updated VIF entry in instance network info cache for port 0445211d-6749-4343-8d64-682d8e3233ab. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:22:17 user nova-compute[75438]: DEBUG nova.network.neutron [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Updating instance_info_cache with network_info: [{"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9b81dc64-d35e-48f9-a18a-f1461791ed4e req-9d570cc8-8945-4cd9-a7fb-3885a454926c service nova] Releasing lock "refresh_cache-4ae460b2-d469-429b-9071-28f8b560bfbd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:22:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-7939f2d5-f9fe-44ec-badd-768221a6c69e req-67d3c911-7200-48f9-9d61-8b45e5a7631f service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7939f2d5-f9fe-44ec-badd-768221a6c69e req-67d3c911-7200-48f9-9d61-8b45e5a7631f service nova] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7939f2d5-f9fe-44ec-badd-768221a6c69e req-67d3c911-7200-48f9-9d61-8b45e5a7631f service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7939f2d5-f9fe-44ec-badd-768221a6c69e req-67d3c911-7200-48f9-9d61-8b45e5a7631f service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-7939f2d5-f9fe-44ec-badd-768221a6c69e req-67d3c911-7200-48f9-9d61-8b45e5a7631f service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] No waiting events found dispatching network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:19 user nova-compute[75438]: WARNING nova.compute.manager [req-7939f2d5-f9fe-44ec-badd-768221a6c69e req-67d3c911-7200-48f9-9d61-8b45e5a7631f service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received unexpected event network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab for instance with vm_state building and task_state spawning.
Nov 09 02:22:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:22:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Instance spawned successfully.
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-ce8440c2-7cd5-49d8-b7fa-b329a7be336d req-3c606e35-1dcf-422e-aa90-8cb405d54369 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ce8440c2-7cd5-49d8-b7fa-b329a7be336d req-3c606e35-1dcf-422e-aa90-8cb405d54369 service nova] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ce8440c2-7cd5-49d8-b7fa-b329a7be336d req-3c606e35-1dcf-422e-aa90-8cb405d54369 service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ce8440c2-7cd5-49d8-b7fa-b329a7be336d req-3c606e35-1dcf-422e-aa90-8cb405d54369 service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-ce8440c2-7cd5-49d8-b7fa-b329a7be336d req-3c606e35-1dcf-422e-aa90-8cb405d54369 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] No waiting events found dispatching network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:21 user nova-compute[75438]: WARNING nova.compute.manager [req-ce8440c2-7cd5-49d8-b7fa-b329a7be336d req-3c606e35-1dcf-422e-aa90-8cb405d54369 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received unexpected event network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab for instance with vm_state building and task_state spawning.
Nov 09 02:22:21 user nova-compute[75438]: INFO nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 09 02:22:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:22:21 user nova-compute[75438]: INFO nova.compute.manager [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Took 8.05 seconds to build instance.
Nov 09 02:22:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6cd47808-ef9d-4e7a-9407-16df845165bd tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.232s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:26 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e is timed out.
Nov 09 02:22:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully detached device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the live domain config.
Nov 09 02:22:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IJTfCzDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:22:26 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfd66a5-dac2-41bb-a984-97665b2f541b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:22:26 user nova-compute[75438]: No targets found.
Nov 09 02:22:26 user nova-compute[75438]: iSNS:
Nov 09 02:22:26 user nova-compute[75438]: No targets found.
Nov 09 02:22:26 user nova-compute[75438]: STATIC:
Nov 09 02:22:26 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150
Nov 09 02:22:26 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:22:26 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:22:26 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:22:26 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:22:26 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:22:26 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066
Nov 09 02:22:26 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:22:26 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:22:26 user nova-compute[75438]: FIRMWARE:
Nov 09 02:22:26 user nova-compute[75438]: No targets found.
Nov 09 02:22:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:22:26 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:22:26 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a955d874-fcd7-4d60-9df9-195172dc11c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f2363-bcac-4386-a5ac-5602a453aee7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:22:26 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:22:26 user nova-compute[75438]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 (non-flash)
Nov 09 02:22:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:22:26 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:22:26 user nova-compute[75438]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 (non-flash)
Nov 09 02:22:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba044ae8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7702faa-bdaf-4d47-83f8-601d07a3bec3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce371a8-53a5-43f5-946b-945a63e8a0aa]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f293169d-5337-452b-b2ec-91ac47d653e9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb4e1a-e46c-4aaa-a2f0-8135d1ea39a3]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039e664-465d-4bbe-9936-82180465ed73]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8e0516-fcc5-4f6f-8c0e-e36c721594cc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260]
Nov 09 02:22:26 user nova-compute[75438]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066, portal: 172.16.0.220,3260] successful.
Nov 09 02:22:26 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee75d3c-16d9-42d2-99b7-e258e5ba1066 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8502b9da-8148-4c61-8ec1-eafede80afd2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== disconnect_volume: return (372ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:22:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:28 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:22:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6e5e907e-1cb9-46d1-ad3c-3483d48e3486 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.694s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:30 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:30 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:22:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:22:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7508MB free_disk=24.82018280029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 350eb030-6104-46bb-9ffe-da6dcb7244ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ab57b224-59ec-4344-a0cc-515d59a3810c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 67e53684-8b40-4255-99a7-bfef8e644c04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 4ae460b2-d469-429b-9071-28f8b560bfbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:22:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.685s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating instance_info_cache with network_info: [{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-changed-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Refreshing instance network info cache due to event network-changed-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] Acquiring lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] Acquired lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG nova.network.neutron [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Refreshing network info cache for port afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:40 user nova-compute[75438]: INFO nova.compute.manager [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Terminating instance
Nov 09 02:22:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-4737dfc1-b928-4b7c-95f5-a9200136505b req-edc3317a-44cd-4ecd-acd4-cad9510d3e14 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-unplugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4737dfc1-b928-4b7c-95f5-a9200136505b req-edc3317a-44cd-4ecd-acd4-cad9510d3e14 service nova] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4737dfc1-b928-4b7c-95f5-a9200136505b req-edc3317a-44cd-4ecd-acd4-cad9510d3e14 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4737dfc1-b928-4b7c-95f5-a9200136505b req-edc3317a-44cd-4ecd-acd4-cad9510d3e14 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-4737dfc1-b928-4b7c-95f5-a9200136505b req-edc3317a-44cd-4ecd-acd4-cad9510d3e14 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] No waiting events found dispatching network-vif-unplugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-4737dfc1-b928-4b7c-95f5-a9200136505b req-edc3317a-44cd-4ecd-acd4-cad9510d3e14 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-unplugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Instance destroyed successfully.
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lazy-loading 'resources' on Instance uuid 350eb030-6104-46bb-9ffe-da6dcb7244ee {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-472143746',display_name='tempest-TestStampPattern-server-472143746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-472143746',id=25,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVAyDRMwjffSqEHQgor1GlyDLaiutN3jGdYixpZry7+mEwIRl0guCFtbKn75XhCI7/ZvTNaQO6Y0hO50K1IkCzCXsM8x/dTz4eGhUYnuIbnYN3L7sdNfCDhQ16Ix2+1ug==',key_name='tempest-TestStampPattern-1748362078',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:14:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af0cb190e1d94289bf11c5544f59f729',ramdisk_id='',reservation_id='r-wu7vj0d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-124162614',owner_user_name='tempest-TestStampPattern-124162614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:18:04Z,user_data=None,user_id='784e9264262a4176839b41cd5d296b94',uuid=350eb030-6104-46bb-9ffe-da6dcb7244ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converting VIF {"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG os_vif [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafa7dc68-43, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25ad5a32-ef17-4b33-90f3-ce40c882145d) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.network.neutron [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updated VIF entry in instance network info cache for port afa7dc68-4325-4ee5-96f3-4b7a2dad9e07. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.network.neutron [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating instance_info_cache with network_info: [{"id": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "address": "fa:16:3e:86:53:45", "network": {"id": "635749bc-5b5b-4a93-b2d6-5dcb287ab994", "bridge": "br-int", "label": "tempest-TestStampPattern-2128576108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af0cb190e1d94289bf11c5544f59f729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa7dc68-43", "ovs_interfaceid": "afa7dc68-4325-4ee5-96f3-4b7a2dad9e07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:41 user nova-compute[75438]: INFO os_vif [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:53:45,bridge_name='br-int',has_traffic_filtering=True,id=afa7dc68-4325-4ee5-96f3-4b7a2dad9e07,network=Network(635749bc-5b5b-4a93-b2d6-5dcb287ab994),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa7dc68-43')
Nov 09 02:22:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Deleting instance files /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee_del
Nov 09 02:22:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Deletion of /opt/stack/data/nova/instances/350eb030-6104-46bb-9ffe-da6dcb7244ee_del complete
Nov 09 02:22:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8dea722a-6a9e-4447-806b-9ad68dfce4eb req-0c7f46fe-6b31-453e-b775-872682724c18 service nova] Releasing lock "refresh_cache-350eb030-6104-46bb-9ffe-da6dcb7244ee" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:41 user nova-compute[75438]: INFO nova.compute.manager [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 09 02:22:41 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:22:41 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:22:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:22:43 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Took 1.59 seconds to deallocate network for instance.
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] No waiting events found dispatching network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:43 user nova-compute[75438]: WARNING nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received unexpected event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 for instance with vm_state deleted and task_state None.
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] No waiting events found dispatching network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:43 user nova-compute[75438]: WARNING nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received unexpected event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 for instance with vm_state deleted and task_state None.
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Acquiring lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] No waiting events found dispatching network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:22:43 user nova-compute[75438]: WARNING nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received unexpected event network-vif-plugged-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 for instance with vm_state deleted and task_state None.
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-41cdfba6-d9f8-4658-b014-a6aecdb1f076 req-c023206a-eff0-4381-b68d-995eca7d2624 service nova] [instance: 350eb030-6104-46bb-9ffe-da6dcb7244ee] Received event network-vif-deleted-afa7dc68-4325-4ee5-96f3-4b7a2dad9e07 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:43 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Deleted allocations for instance 350eb030-6104-46bb-9ffe-da6dcb7244ee
Nov 09 02:22:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a324b3fb-dfaf-45c6-8aff-4b321d88e077 tempest-TestStampPattern-124162614 tempest-TestStampPattern-124162614-project-member] Lock "350eb030-6104-46bb-9ffe-da6dcb7244ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.412s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:22:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:22:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:22:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:23:00 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Creating image(s)
Nov 09 02:23:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab2b7b0-8519-424b-b3b9-39152b4c25c1/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Start _get_guest_xml network_info=[{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9c229fb0-d186-4e9e-b85e-baec5753376f', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ab2b7b0-8519-424b-b3b9-39152b4c25c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'serial': 'c58efce2-07e1-4947-b9fe-94da4ddc6a2f'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:23:01 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:23:01 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:23:01 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:23:01 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.020s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:23:01 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec8c21-6ffe-4c48-884c-96591a6b133a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:23:01 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a51fe5-ffac-4c1e-9bc5-2b27b3fa85e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f] added
Nov 09 02:23:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300e839-e34a-42b3-a72e-7790d121d593]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ef878-6e64-4628-971a-e8307a7a3c5f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtYWyQTg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtYWyQTg" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[505f5094-f325-4fd6-a575-49e4c8fe5d68]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtYWyQTg'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a540db-795f-469c-abfd-d0cb4676a451]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f45d0d-a3b2-414e-bdde-c7fa335b5479]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e7b849-2202-4933-9dff-83d1f29e97d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]
Nov 09 02:23:01 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.
Nov 09 02:23:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c232cadc-5b77-4e3f-a644-6be20880540e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[995ad135-3852-4a45-bfaf-025b48eecc1f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:01 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:01 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e04b37a-8047-4cfb-bed2-141da4da2b75]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:23:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26633356666633837', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633356666633837', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-674388167',display_name='tempest-ServerActionsTestOtherA-server-674388167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-674388167',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-53ezskuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=0ab2b7b0-8519-424b-b3b9-39152b4c25c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:23:02 user nova-compute[75438]:   <uuid>0ab2b7b0-8519-424b-b3b9-39152b4c25c1</uuid>
Nov 09 02:23:02 user nova-compute[75438]:   <name>instance-0000001f</name>
Nov 09 02:23:02 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:23:02 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:23:02 user nova-compute[75438]:   <metadata>
Nov 09 02:23:02 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:23:02 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:23:02 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherA-server-674388167</nova:name>
Nov 09 02:23:02 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:23:01</nova:creationTime>
Nov 09 02:23:02 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:23:02 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:23:02 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:23:02 user nova-compute[75438]:       <nova:owner>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:user uuid="e95d2465b0af4dcab397b5ccc2809c59">tempest-ServerActionsTestOtherA-1813489270-project-member</nova:user>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:project uuid="7a4b29710bb14b8fb9714109aec43dc6">tempest-ServerActionsTestOtherA-1813489270</nova:project>
Nov 09 02:23:02 user nova-compute[75438]:       </nova:owner>
Nov 09 02:23:02 user nova-compute[75438]:       <nova:ports>
Nov 09 02:23:02 user nova-compute[75438]:         <nova:port uuid="44e587c3-eb25-4da8-b054-5439a13ebf51">
Nov 09 02:23:02 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:23:02 user nova-compute[75438]:         </nova:port>
Nov 09 02:23:02 user nova-compute[75438]:       </nova:ports>
Nov 09 02:23:02 user nova-compute[75438]:     </nova:instance>
Nov 09 02:23:02 user nova-compute[75438]:   </metadata>
Nov 09 02:23:02 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:23:02 user nova-compute[75438]:     <system>
Nov 09 02:23:02 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:23:02 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:23:02 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:23:02 user nova-compute[75438]:       <entry name="serial">0ab2b7b0-8519-424b-b3b9-39152b4c25c1</entry>
Nov 09 02:23:02 user nova-compute[75438]:       <entry name="uuid">0ab2b7b0-8519-424b-b3b9-39152b4c25c1</entry>
Nov 09 02:23:02 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:23:02 user nova-compute[75438]:     </system>
Nov 09 02:23:02 user nova-compute[75438]:   </sysinfo>
Nov 09 02:23:02 user nova-compute[75438]:   <os>
Nov 09 02:23:02 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:23:02 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:23:02 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:23:02 user nova-compute[75438]:   </os>
Nov 09 02:23:02 user nova-compute[75438]:   <features>
Nov 09 02:23:02 user nova-compute[75438]:     <acpi/>
Nov 09 02:23:02 user nova-compute[75438]:     <apic/>
Nov 09 02:23:02 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:23:02 user nova-compute[75438]:   </features>
Nov 09 02:23:02 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:23:02 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:23:02 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:23:02 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:23:02 user nova-compute[75438]:   </clock>
Nov 09 02:23:02 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:23:02 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:23:02 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:23:02 user nova-compute[75438]:   </cpu>
Nov 09 02:23:02 user nova-compute[75438]:   <devices>
Nov 09 02:23:02 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:23:02 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:23:02 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:23:02 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:23:02 user nova-compute[75438]:       <serial>c58efce2-07e1-4947-b9fe-94da4ddc6a2f</serial>
Nov 09 02:23:02 user nova-compute[75438]:     </disk>
Nov 09 02:23:02 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:23:02 user nova-compute[75438]:       <mac address="fa:16:3e:36:6c:75"/>
Nov 09 02:23:02 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:23:02 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:23:02 user nova-compute[75438]:       <target dev="tap44e587c3-eb"/>
Nov 09 02:23:02 user nova-compute[75438]:     </interface>
Nov 09 02:23:02 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:23:02 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/0ab2b7b0-8519-424b-b3b9-39152b4c25c1/console.log" append="off"/>
Nov 09 02:23:02 user nova-compute[75438]:     </serial>
Nov 09 02:23:02 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:23:02 user nova-compute[75438]:     <video>
Nov 09 02:23:02 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:23:02 user nova-compute[75438]:     </video>
Nov 09 02:23:02 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:23:02 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:23:02 user nova-compute[75438]:     </rng>
Nov 09 02:23:02 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:23:02 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:23:02 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:23:02 user nova-compute[75438]:     </memballoon>
Nov 09 02:23:02 user nova-compute[75438]:   </devices>
Nov 09 02:23:02 user nova-compute[75438]: </domain>
Nov 09 02:23:02 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-674388167',display_name='tempest-ServerActionsTestOtherA-server-674388167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-674388167',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-53ezskuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:21:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=0ab2b7b0-8519-424b-b3b9-39152b4c25c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG os_vif [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '183ca3fc-fdaf-5ad4-9f81-89d4e2e9c14f', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44e587c3-eb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44e587c3-eb, col_values=(('qos', UUID('3145dd63-5c1f-45b6-8c77-60385277b6cb')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44e587c3-eb, col_values=(('external_ids', {'iface-id': '44e587c3-eb25-4da8-b054-5439a13ebf51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6c:75', 'vm-uuid': '0ab2b7b0-8519-424b-b3b9-39152b4c25c1'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:02 user nova-compute[75438]: INFO os_vif [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb')
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:23:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No VIF found with MAC fa:16:3e:36:6c:75, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG nova.objects.instance [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:03 user nova-compute[75438]: INFO nova.compute.manager [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attaching volume 61281b3d-adce-4f98-b1b6-0e4568b76c79 to /dev/vdb
Nov 09 02:23:03 user nova-compute[75438]: DEBUG os_brick.utils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa3e00c-39a4-45d1-bccf-e59d29e973c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd53431-13a0-41ce-aa89-74ffe6efbc07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03e788-3497-4804-ba29-650291610650]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8c17ad-10c2-4636-a34b-080398e1202c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:23:03 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:23:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fc4de3-096b-4b9d-b337-dfa1b1a4680b]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG os_brick.utils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating existing volume attachment record: a1a7f079-f2fc-498f-8f6a-2d37ef53e0b4 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6301302-88e3-41e6-a516-a5ea177beb1e req-a8baa5d5-683a-4b51-87df-988c8f37b145 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6301302-88e3-41e6-a516-a5ea177beb1e req-a8baa5d5-683a-4b51-87df-988c8f37b145 service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6301302-88e3-41e6-a516-a5ea177beb1e req-a8baa5d5-683a-4b51-87df-988c8f37b145 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6301302-88e3-41e6-a516-a5ea177beb1e req-a8baa5d5-683a-4b51-87df-988c8f37b145 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6301302-88e3-41e6-a516-a5ea177beb1e req-a8baa5d5-683a-4b51-87df-988c8f37b145 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:23:04 user nova-compute[75438]: WARNING nova.compute.manager [req-e6301302-88e3-41e6-a516-a5ea177beb1e req-a8baa5d5-683a-4b51-87df-988c8f37b145 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state building and task_state spawning.
Nov 09 02:23:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:23:06 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance spawned successfully.
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-dde9b0b1-dd3a-45e9-9671-b9b5da44c08c req-9a48ebbc-1371-41d5-8a7b-c4a5fdb86421 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dde9b0b1-dd3a-45e9-9671-b9b5da44c08c req-9a48ebbc-1371-41d5-8a7b-c4a5fdb86421 service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dde9b0b1-dd3a-45e9-9671-b9b5da44c08c req-9a48ebbc-1371-41d5-8a7b-c4a5fdb86421 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dde9b0b1-dd3a-45e9-9671-b9b5da44c08c req-9a48ebbc-1371-41d5-8a7b-c4a5fdb86421 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-dde9b0b1-dd3a-45e9-9671-b9b5da44c08c req-9a48ebbc-1371-41d5-8a7b-c4a5fdb86421 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:23:06 user nova-compute[75438]: WARNING nova.compute.manager [req-dde9b0b1-dd3a-45e9-9671-b9b5da44c08c req-9a48ebbc-1371-41d5-8a7b-c4a5fdb86421 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state building and task_state spawning.
Nov 09 02:23:06 user nova-compute[75438]: INFO nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 09 02:23:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:23:06 user nova-compute[75438]: INFO nova.compute.manager [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Took 90.80 seconds to build instance.
Nov 09 02:23:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b5201cf9-4a89-4111-bc16-956734c8da67 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.956s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:23:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:23:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:23:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:23:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:23:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:23:28 user nova-compute[75438]: INFO nova.compute.claims [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Claim successful on node user
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSncYwgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:23:29 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:23:29 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:23:29 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9165576-3092-421d-bf53-6e8f7c5c1161]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:23:29 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[decae79c-6ede-4fdf-ac5b-4dd78d7efbe9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79] added
Nov 09 02:23:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[677603d4-727f-4c3a-8cca-874bfad3b5fc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ef197b-a8fa-4305-a09f-928fa0d16955]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSncYwgU {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSncYwgU" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c585be4-d43a-4976-8efe-1554ac402a02]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xSncYwgU'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0464fe-2c44-4e6c-a673-e00e03a526c6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092fc45-16b2-4838-ba4b-6e1c9f271685]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b807992d-e715-4ace-bb75-b33febb87664]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260]
Nov 09 02:23:29 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260] successful.
Nov 09 02:23:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ba2caa-af32-4cf3-b060-8f3fddd8c81c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5f77d-a7e4-4985-b770-5b6bd6db2a63]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:29 user nova-compute[75438]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 (non-flash)
Nov 09 02:23:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67e64f9-1b31-4b29-8a42-ccfc9fc991c6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSncYwgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.network.neutron [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:23:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:23:29 user nova-compute[75438]: DEBUG nova.policy [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5297e15fd14f1395cb606e791c4202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c21c58de14dbda4534441cad48918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:23:29 user nova-compute[75438]: INFO nova.virt.block_device [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Booting with volume snapshot 96bf2da7-6f27-4314-913a-83ace833aa3c at /dev/vda
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Successfully created port: a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26361613832346233', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361613832346233', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:23:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:23:30 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:23:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:23:30 user nova-compute[75438]:   <serial>61281b3d-adce-4f98-b1b6-0e4568b76c79</serial>
Nov 09 02:23:30 user nova-compute[75438]: </disk>
Nov 09 02:23:30 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:23:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] No VIF found with MAC fa:16:3e:03:d7:69, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-98c39452-01eb-48e8-88ec-08a2109cddda tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.514s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Successfully updated port: a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "refresh_cache-83289a7b-b6c3-443c-a4c0-613e1d06dea3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquired lock "refresh_cache-83289a7b-b6c3-443c-a4c0-613e1d06dea3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-changed-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Refreshing instance network info cache due to event network-changed-a2871956-7aeb-423d-b611-3dc302445965. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] Acquiring lock "refresh_cache-83289a7b-b6c3-443c-a4c0-613e1d06dea3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Updating instance_info_cache with network_info: [{"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Releasing lock "refresh_cache-83289a7b-b6c3-443c-a4c0-613e1d06dea3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Instance network_info: |[{"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] Acquired lock "refresh_cache-83289a7b-b6c3-443c-a4c0-613e1d06dea3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.network.neutron [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Refreshing network info cache for port a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:23:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Updated VIF entry in instance network info cache for port a2871956-7aeb-423d-b611-3dc302445965. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Updating instance_info_cache with network_info: [{"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-be7c62d7-8f5e-448b-9759-3e2191d195aa req-35dae942-6e10-4a54-b838-d829cf165054 service nova] Releasing lock "refresh_cache-83289a7b-b6c3-443c-a4c0-613e1d06dea3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:32 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:33 user nova-compute[75438]: INFO nova.compute.manager [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Detaching volume 61281b3d-adce-4f98-b1b6-0e4568b76c79
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:33 user nova-compute[75438]: INFO nova.virt.block_device [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attempting to driver detach volume 61281b3d-adce-4f98-b1b6-0e4568b76c79 from mountpoint /dev/vdb
Nov 09 02:23:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Attempting to detach device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:23:33 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:23:33 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:23:33 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:23:33 user nova-compute[75438]:   <serial>61281b3d-adce-4f98-b1b6-0e4568b76c79</serial>
Nov 09 02:23:33 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:23:33 user nova-compute[75438]: </disk>
Nov 09 02:23:33 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:23:33 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully detached device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the persistent domain config.
Nov 09 02:23:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:23:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:23:33 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:23:33 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:23:33 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:23:33 user nova-compute[75438]:   <serial>61281b3d-adce-4f98-b1b6-0e4568b76c79</serial>
Nov 09 02:23:33 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:23:33 user nova-compute[75438]: </disk>
Nov 09 02:23:33 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json" returned: 0 in 0.515s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:23:35 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:23:35 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7515MB free_disk=24.805862426757812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-changed-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Refreshing instance network info cache due to event network-changed-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] Acquiring lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] Acquired lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG nova.network.neutron [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Refreshing network info cache for port fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:23:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance ab57b224-59ec-4344-a0cc-515d59a3810c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 67e53684-8b40-4255-99a7-bfef8e644c04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 4ae460b2-d469-429b-9071-28f8b560bfbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 83289a7b-b6c3-443c-a4c0-613e1d06dea3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:36 user nova-compute[75438]: INFO nova.compute.manager [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Terminating instance
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updated VIF entry in instance network info cache for port fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updating instance_info_cache with network_info: [{"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-da3434b0-a789-4d13-9ac6-6f6fa9ca5315 req-03e626b2-7f11-44d8-a011-9e1c0b97a946 service nova] Releasing lock "refresh_cache-ab57b224-59ec-4344-a0cc-515d59a3810c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.923s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Instance destroyed successfully.
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.objects.instance [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'resources' on Instance uuid ab57b224-59ec-4344-a0cc-515d59a3810c {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1602786864',display_name='tempest-AttachVolumeNegativeTest-server-1602786864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1602786864',id=32,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlIpZaBKPflVlcRgXFZqIyP2ZGG0+Z7Uunhp4MsVJmm8vcOR54cOzdv/iPxI59/fJFZAxlMJ0KfM2ftn8TNRkqCLdEAXFS+EGezmMdO1TKKSkpQlhobtazZpjO1KLGk8Q==',key_name='tempest-keypair-1245155042',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:21:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-erwnbhse',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=ab57b224-59ec-4344-a0cc-515d59a3810c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "address": "fa:16:3e:1c:87:b9", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd89000c-d9", "ovs_interfaceid": "fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG os_vif [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd89000c-d9, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95eca8a8-d9c9-4def-933b-917158a313e2) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:23:36 user nova-compute[75438]: INFO os_vif [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:87:b9,bridge_name='br-int',has_traffic_filtering=True,id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd89000c-d9')
Nov 09 02:23:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Deleting instance files /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c_del
Nov 09 02:23:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Deletion of /opt/stack/data/nova/instances/ab57b224-59ec-4344-a0cc-515d59a3810c_del complete
Nov 09 02:23:37 user nova-compute[75438]: INFO nova.compute.manager [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-vif-unplugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] No waiting events found dispatching network-vif-unplugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-vif-unplugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] Acquiring lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] No waiting events found dispatching network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:23:37 user nova-compute[75438]: WARNING nova.compute.manager [req-6f567e7a-987e-4fb9-9846-d8040829643d req-450b51b4-dce4-4c64-805d-848a44ce1ec8 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received unexpected event network-vif-plugged-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 for instance with vm_state active and task_state deleting.
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:37 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Took 0.84 seconds to deallocate network for instance.
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-73234158-c425-4194-8ca3-ae4fdad6e7f2 req-445af82c-7adb-47c7-922a-b5cb6fc998f3 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Received event network-vif-deleted-fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:37 user nova-compute[75438]: INFO nova.compute.manager [req-73234158-c425-4194-8ca3-ae4fdad6e7f2 req-445af82c-7adb-47c7-922a-b5cb6fc998f3 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Neutron deleted interface fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9; detaching it from the instance and deleting it from the info cache
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.network.neutron [req-73234158-c425-4194-8ca3-ae4fdad6e7f2 req-445af82c-7adb-47c7-922a-b5cb6fc998f3 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-73234158-c425-4194-8ca3-ae4fdad6e7f2 req-445af82c-7adb-47c7-922a-b5cb6fc998f3 service nova] [instance: ab57b224-59ec-4344-a0cc-515d59a3810c] Detach interface failed, port_id=fd89000c-d9b6-47d8-b1e1-16b8bd94a2c9, reason: Instance ab57b224-59ec-4344-a0cc-515d59a3810c could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:23:37 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.561s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:38 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Deleted allocations for instance ab57b224-59ec-4344-a0cc-515d59a3810c
Nov 09 02:23:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1b328a79-2bdb-4898-b40c-bfde87668478 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "ab57b224-59ec-4344-a0cc-515d59a3810c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:23:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating instance_info_cache with network_info: [{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG os_brick.utils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938ae10-64c3-4729-b587-e42ec3f62873]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34a0b1b-4e88-4694-b497-2ed928bf4016]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[450cb41a-7138-4bfa-b229-d2f92d44e489]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0270467-5b32-48f5-8fdc-eb52008d0cba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:23:41 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:23:41 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05a3c64-d788-460b-977f-0e90f175918f]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG os_brick.utils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Updating existing volume attachment record: 92066051-7fee-4c04-a099-fd183b08541b {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:23:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:42 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:42 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:23:42 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:23:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:23:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:23:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:54 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e is timed out.
Nov 09 02:23:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully detached device vdb from instance 77276a3a-25bc-4fc4-978b-8597ce732f2e from the live domain config.
Nov 09 02:23:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSncYwgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:23:54 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af21eb-d619-4cf7-b3a9-ad3bf048e056]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:23:54 user nova-compute[75438]: No targets found.
Nov 09 02:23:54 user nova-compute[75438]: iSNS:
Nov 09 02:23:54 user nova-compute[75438]: No targets found.
Nov 09 02:23:54 user nova-compute[75438]: STATIC:
Nov 09 02:23:54 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150
Nov 09 02:23:54 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:23:54 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:23:54 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:23:54 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:23:54 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:23:54 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79
Nov 09 02:23:54 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:23:54 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:23:54 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f
Nov 09 02:23:54 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:23:54 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:23:54 user nova-compute[75438]: FIRMWARE:
Nov 09 02:23:54 user nova-compute[75438]: No targets found.
Nov 09 02:23:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:23:54 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:23:54 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ce651-7af8-49a0-ad6b-8e055799528c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba47f02-937b-486d-a564-8af8e205d4cb]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:54 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:54 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:54 user nova-compute[75438]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 (non-flash)
Nov 09 02:23:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:23:54 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:23:54 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:23:54 user nova-compute[75438]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 (non-flash)
Nov 09 02:23:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0429acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[517530f0-2281-4a54-b99c-9a174c9a144f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46316da-992f-4341-ba4c-f8db3694f97a]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e475b4-bbcf-477b-bfbd-e090ebf22415]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ce9e1-00e1-4b5f-8f74-e4c5faa3992d]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[406ea532-bb86-4293-a0ce-cbc0684bf98f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459d9f4-3874-407e-b71b-2e205bf0d957]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260]
Nov 09 02:23:54 user nova-compute[75438]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79, portal: 172.16.0.220,3260] successful.
Nov 09 02:23:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61281b3d-adce-4f98-b1b6-0e4568b76c79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cca450-8ed4-45a8-8c90-6ca16feeb23e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== disconnect_volume: return (354ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:23:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:23:55 user nova-compute[75438]: DEBUG nova.objects.instance [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:23:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-29ed9f35-69e5-4184-bdad-0b78dba4bd13 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.147s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:23:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-changed-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Refreshing instance network info cache due to event network-changed-e3d094d5-d281-4ef3-a491-9e87a7c50d2a. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] Acquiring lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] Acquired lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG nova.network.neutron [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Refreshing network info cache for port e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG nova.network.neutron [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updated VIF entry in instance network info cache for port e3d094d5-d281-4ef3-a491-9e87a7c50d2a. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG nova.network.neutron [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updating instance_info_cache with network_info: [{"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:23:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b637f3f6-487d-4cc7-ae62-04feaa2e2de9 req-8fe1d1fc-ddec-49c9-bd1f-907143ba8698 service nova] Releasing lock "refresh_cache-67e53684-8b40-4255-99a7-bfef8e644c04" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:03 user nova-compute[75438]: INFO nova.compute.manager [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Terminating instance
Nov 09 02:24:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-ed361924-a25d-4f07-b03f-dc77ed306a1d req-6a810710-3a8f-451f-bca9-239ebca3b4c5 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-vif-unplugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ed361924-a25d-4f07-b03f-dc77ed306a1d req-6a810710-3a8f-451f-bca9-239ebca3b4c5 service nova] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ed361924-a25d-4f07-b03f-dc77ed306a1d req-6a810710-3a8f-451f-bca9-239ebca3b4c5 service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ed361924-a25d-4f07-b03f-dc77ed306a1d req-6a810710-3a8f-451f-bca9-239ebca3b4c5 service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-ed361924-a25d-4f07-b03f-dc77ed306a1d req-6a810710-3a8f-451f-bca9-239ebca3b4c5 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] No waiting events found dispatching network-vif-unplugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:24:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-ed361924-a25d-4f07-b03f-dc77ed306a1d req-6a810710-3a8f-451f-bca9-239ebca3b4c5 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-vif-unplugged-0445211d-6749-4343-8d64-682d8e3233ab for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:24:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Instance destroyed successfully.
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lazy-loading 'resources' on Instance uuid 4ae460b2-d469-429b-9071-28f8b560bfbd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-182581968',display_name='tempest-VolumesNegativeTest-instance-182581968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-182581968',id=34,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bcd1d351887b435ab410721ef8450f39',ramdisk_id='',reservation_id='r-46bicnn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1057879860',owner_user_name='tempest-VolumesNegativeTest-1057879860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:22:21Z,user_data=None,user_id='60a216aff05344cbbc74ba03e8f7999e',uuid=4ae460b2-d469-429b-9071-28f8b560bfbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Converting VIF {"id": "0445211d-6749-4343-8d64-682d8e3233ab", "address": "fa:16:3e:c0:e9:c8", "network": {"id": "9a3af2ce-5481-4d12-93e8-c2c550485368", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2cc72d56a114951a5ee9b9cf29ed959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0445211d-67", "ovs_interfaceid": "0445211d-6749-4343-8d64-682d8e3233ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG os_vif [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0445211d-67, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab4ee809-00c4-4ee8-9083-80f50423b101) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:04 user nova-compute[75438]: INFO os_vif [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:e9:c8,bridge_name='br-int',has_traffic_filtering=True,id=0445211d-6749-4343-8d64-682d8e3233ab,network=Network(9a3af2ce-5481-4d12-93e8-c2c550485368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0445211d-67')
Nov 09 02:24:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Deleting instance files /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd_del
Nov 09 02:24:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Deletion of /opt/stack/data/nova/instances/4ae460b2-d469-429b-9071-28f8b560bfbd_del complete
Nov 09 02:24:04 user nova-compute[75438]: INFO nova.compute.manager [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 09 02:24:04 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:24:04 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:04 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Took 0.53 seconds to deallocate network for instance.
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:05 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Deleted allocations for instance 4ae460b2-d469-429b-9071-28f8b560bfbd
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d2ec3ac-2372-4fc1-8e4c-ad69e76ea360 tempest-VolumesNegativeTest-1057879860 tempest-VolumesNegativeTest-1057879860-project-member] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG nova.compute.manager [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] Acquiring lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] Lock "4ae460b2-d469-429b-9071-28f8b560bfbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG nova.compute.manager [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] No waiting events found dispatching network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:24:05 user nova-compute[75438]: WARNING nova.compute.manager [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received unexpected event network-vif-plugged-0445211d-6749-4343-8d64-682d8e3233ab for instance with vm_state deleted and task_state None.
Nov 09 02:24:05 user nova-compute[75438]: DEBUG nova.compute.manager [req-13185b9e-4bb1-4e8f-9793-993714d3f2a0 req-4713d968-d74c-4cd5-b6e0-cda45fd63761 service nova] [instance: 4ae460b2-d469-429b-9071-28f8b560bfbd] Received event network-vif-deleted-0445211d-6749-4343-8d64-682d8e3233ab {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lazy-loading 'flavor' on Instance uuid 67e53684-8b40-4255-99a7-bfef8e644c04 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:06 user nova-compute[75438]: INFO nova.compute.manager [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Attaching volume cd66b512-9b35-45f0-9c57-ffecce21d28e to /dev/vdb
Nov 09 02:24:06 user nova-compute[75438]: DEBUG os_brick.utils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca45d31-31ef-4729-bdf9-cd0766f73e6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0d4df0-3673-4a6e-ab51-5c8077046d26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[31929353-7c57-4ab0-84ca-cbd5d5d36be8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d562d0-78eb-4979-871d-d9a1774aeadd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:06 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:24:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b7b265-3ccc-47f2-a05f-90b5b6bf519d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG os_brick.utils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:06 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updating existing volume attachment record: 122d3fb8-7aff-40e3-8d23-e36d23edfb4d {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:24:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Creating image(s)
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Ensure instance console log exists: /opt/stack/data/nova/instances/83289a7b-b6c3-443c-a4c0-613e1d06dea3/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Start _get_guest_xml network_info=[{"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '92066051-7fee-4c04-a099-fd183b08541b', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbZNVXCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83289a7b-b6c3-443c-a4c0-613e1d06dea3', 'attached_at': '', 'detached_at': '', 'volume_id': '8b54b0fc-099b-4b2d-a618-391b1c28da5c', 'serial': '8b54b0fc-099b-4b2d-a618-391b1c28da5c'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:24:07 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:24:07 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbZNVXCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:07 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:07 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:07 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea0abe3-9bd6-488d-ae99-c881536fa579]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:24:07 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ddc117-ca00-45ea-935b-baa12f425935]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c] added
Nov 09 02:24:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc365e0-d062-4bf3-8cd9-37ee9c62e365]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a05958-589a-4c30-ac9d-8f97d4770a6e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LbZNVXCA {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LbZNVXCA" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[23346141-902d-429a-b04d-8ee1d3899308]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LbZNVXCA'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a444e-cd01-4d0f-957a-20f420ec4f0d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b456f1c-36cc-4363-8fbf-63a46e3641ed]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:24:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:24:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd0407d-5b37-4c69-8b1a-00a13f430a19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260]
Nov 09 02:24:07 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260] successful.
Nov 09 02:24:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[09303ea5-b731-4043-b3a6-e437623f3dbb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed259cfe-8d18-401a-8df3-791d0074dfd8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:24:07 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a0cdf-928c-49de-9ea0-1cf4e8bf7156]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:24:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbZNVXCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23732393365616233', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732393365616233', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876384582',display_name='tempest-TestVolumeBootPattern-server-876384582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876384582',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-vicf20xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:23:30Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=83289a7b-b6c3-443c-a4c0-613e1d06dea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.objects.instance [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'pci_devices' on Instance uuid 83289a7b-b6c3-443c-a4c0-613e1d06dea3 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:24:08 user nova-compute[75438]:   <uuid>83289a7b-b6c3-443c-a4c0-613e1d06dea3</uuid>
Nov 09 02:24:08 user nova-compute[75438]:   <name>instance-00000023</name>
Nov 09 02:24:08 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:24:08 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:24:08 user nova-compute[75438]:   <metadata>
Nov 09 02:24:08 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:24:08 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:24:08 user nova-compute[75438]:       <nova:name>tempest-TestVolumeBootPattern-server-876384582</nova:name>
Nov 09 02:24:08 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:24:07</nova:creationTime>
Nov 09 02:24:08 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:24:08 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:24:08 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:24:08 user nova-compute[75438]:       <nova:owner>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:user uuid="3b5297e15fd14f1395cb606e791c4202">tempest-TestVolumeBootPattern-1394927917-project-member</nova:user>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:project uuid="8f6c21c58de14dbda4534441cad48918">tempest-TestVolumeBootPattern-1394927917</nova:project>
Nov 09 02:24:08 user nova-compute[75438]:       </nova:owner>
Nov 09 02:24:08 user nova-compute[75438]:       <nova:ports>
Nov 09 02:24:08 user nova-compute[75438]:         <nova:port uuid="a2871956-7aeb-423d-b611-3dc302445965">
Nov 09 02:24:08 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 02:24:08 user nova-compute[75438]:         </nova:port>
Nov 09 02:24:08 user nova-compute[75438]:       </nova:ports>
Nov 09 02:24:08 user nova-compute[75438]:     </nova:instance>
Nov 09 02:24:08 user nova-compute[75438]:   </metadata>
Nov 09 02:24:08 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:24:08 user nova-compute[75438]:     <system>
Nov 09 02:24:08 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:24:08 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:24:08 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:24:08 user nova-compute[75438]:       <entry name="serial">83289a7b-b6c3-443c-a4c0-613e1d06dea3</entry>
Nov 09 02:24:08 user nova-compute[75438]:       <entry name="uuid">83289a7b-b6c3-443c-a4c0-613e1d06dea3</entry>
Nov 09 02:24:08 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:24:08 user nova-compute[75438]:     </system>
Nov 09 02:24:08 user nova-compute[75438]:   </sysinfo>
Nov 09 02:24:08 user nova-compute[75438]:   <os>
Nov 09 02:24:08 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:24:08 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:24:08 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:24:08 user nova-compute[75438]:   </os>
Nov 09 02:24:08 user nova-compute[75438]:   <features>
Nov 09 02:24:08 user nova-compute[75438]:     <acpi/>
Nov 09 02:24:08 user nova-compute[75438]:     <apic/>
Nov 09 02:24:08 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:24:08 user nova-compute[75438]:   </features>
Nov 09 02:24:08 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:24:08 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:24:08 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:24:08 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:24:08 user nova-compute[75438]:   </clock>
Nov 09 02:24:08 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:24:08 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:24:08 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:24:08 user nova-compute[75438]:   </cpu>
Nov 09 02:24:08 user nova-compute[75438]:   <devices>
Nov 09 02:24:08 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:24:08 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:08 user nova-compute[75438]:       <source dev="/dev/sdd"/>
Nov 09 02:24:08 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:24:08 user nova-compute[75438]:       <serial>8b54b0fc-099b-4b2d-a618-391b1c28da5c</serial>
Nov 09 02:24:08 user nova-compute[75438]:     </disk>
Nov 09 02:24:08 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:24:08 user nova-compute[75438]:       <mac address="fa:16:3e:01:9a:e4"/>
Nov 09 02:24:08 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:24:08 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:24:08 user nova-compute[75438]:       <target dev="tapa2871956-7a"/>
Nov 09 02:24:08 user nova-compute[75438]:     </interface>
Nov 09 02:24:08 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:24:08 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/83289a7b-b6c3-443c-a4c0-613e1d06dea3/console.log" append="off"/>
Nov 09 02:24:08 user nova-compute[75438]:     </serial>
Nov 09 02:24:08 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:24:08 user nova-compute[75438]:     <video>
Nov 09 02:24:08 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:24:08 user nova-compute[75438]:     </video>
Nov 09 02:24:08 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:24:08 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:24:08 user nova-compute[75438]:     </rng>
Nov 09 02:24:08 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:24:08 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:24:08 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:24:08 user nova-compute[75438]:     </memballoon>
Nov 09 02:24:08 user nova-compute[75438]:   </devices>
Nov 09 02:24:08 user nova-compute[75438]: </domain>
Nov 09 02:24:08 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876384582',display_name='tempest-TestVolumeBootPattern-server-876384582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876384582',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-vicf20xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:23:30Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=83289a7b-b6c3-443c-a4c0-613e1d06dea3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG os_vif [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff6d135c-29fc-545d-ac26-7b93cee84363', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2871956-7a, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2871956-7a, col_values=(('qos', UUID('cb1d8684-7b20-4139-a4cc-696df3b258a2')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2871956-7a, col_values=(('external_ids', {'iface-id': 'a2871956-7aeb-423d-b611-3dc302445965', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:9a:e4', 'vm-uuid': '83289a7b-b6c3-443c-a4c0-613e1d06dea3'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:08 user nova-compute[75438]: INFO os_vif [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a')
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:24:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No VIF found with MAC fa:16:3e:01:9a:e4, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "28f31033-0b5e-4968-8641-abee31542b90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:24:09 user nova-compute[75438]: INFO nova.compute.claims [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Claim successful on node user
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:24:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:09 user nova-compute[75438]: INFO nova.virt.block_device [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Booting with volume-backed-image f16943d9-f085-4472-9bf0-c9432a882a19 at /dev/vda
Nov 09 02:24:09 user nova-compute[75438]: DEBUG nova.policy [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3160dcb696a24d3db8bd3a22064cbd7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7d490c388e64d5fbdeec47eb532482e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:24:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-d55aeba8-80d5-4372-a7c0-2d2c9b4c6668 req-32f4e96d-9881-4479-a688-74247f94bd72 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d55aeba8-80d5-4372-a7c0-2d2c9b4c6668 req-32f4e96d-9881-4479-a688-74247f94bd72 service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d55aeba8-80d5-4372-a7c0-2d2c9b4c6668 req-32f4e96d-9881-4479-a688-74247f94bd72 service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d55aeba8-80d5-4372-a7c0-2d2c9b4c6668 req-32f4e96d-9881-4479-a688-74247f94bd72 service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-d55aeba8-80d5-4372-a7c0-2d2c9b4c6668 req-32f4e96d-9881-4479-a688-74247f94bd72 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:24:10 user nova-compute[75438]: WARNING nova.compute.manager [req-d55aeba8-80d5-4372-a7c0-2d2c9b4c6668 req-32f4e96d-9881-4479-a688-74247f94bd72 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received unexpected event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with vm_state building and task_state spawning.
Nov 09 02:24:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Successfully created port: 0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Successfully updated port: 0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-changed-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Refreshing instance network info cache due to event network-changed-0ca6d939-5f08-4666-8cac-bdb1abc805dc. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] Acquiring lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating instance_info_cache with network_info: [{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance network_info: |[{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] Acquired lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:24:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Refreshing network info cache for port 0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.network.neutron [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updated VIF entry in instance network info cache for port 0ca6d939-5f08-4666-8cac-bdb1abc805dc. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.network.neutron [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating instance_info_cache with network_info: [{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4e97cec0-14c8-4942-a762-30648bdb4ae2 req-c3b00c16-ff96-4646-9680-3aa3225678d2 service nova] Releasing lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:24:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Instance spawned successfully.
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-d7b3d8d1-4f97-43a5-8ad9-0fe04d3fc24d req-b955cfd4-4f0a-4c0c-9a84-3393fcaaa036 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7b3d8d1-4f97-43a5-8ad9-0fe04d3fc24d req-b955cfd4-4f0a-4c0c-9a84-3393fcaaa036 service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7b3d8d1-4f97-43a5-8ad9-0fe04d3fc24d req-b955cfd4-4f0a-4c0c-9a84-3393fcaaa036 service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7b3d8d1-4f97-43a5-8ad9-0fe04d3fc24d req-b955cfd4-4f0a-4c0c-9a84-3393fcaaa036 service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-d7b3d8d1-4f97-43a5-8ad9-0fe04d3fc24d req-b955cfd4-4f0a-4c0c-9a84-3393fcaaa036 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:24:12 user nova-compute[75438]: WARNING nova.compute.manager [req-d7b3d8d1-4f97-43a5-8ad9-0fe04d3fc24d req-b955cfd4-4f0a-4c0c-9a84-3393fcaaa036 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received unexpected event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with vm_state building and task_state spawning.
Nov 09 02:24:12 user nova-compute[75438]: INFO nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 09 02:24:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:24:12 user nova-compute[75438]: INFO nova.compute.manager [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Took 43.73 seconds to build instance.
Nov 09 02:24:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-537ddc21-e23b-4c49-bbeb-6fe5d9d84297 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.827s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-changed-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Refreshing instance network info cache due to event network-changed-cca4d3f1-d39a-4163-aa83-b0df831b92cb. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:24:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:24:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:24:17 user nova-compute[75438]: DEBUG nova.network.neutron [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Refreshing network info cache for port cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:24:18 user nova-compute[75438]: DEBUG nova.network.neutron [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updated VIF entry in instance network info cache for port cca4d3f1-d39a-4163-aa83-b0df831b92cb. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:24:18 user nova-compute[75438]: DEBUG nova.network.neutron [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a6aeaa07-34d4-47ee-bff1-d20633d91f71 req-413e4de4-229e-465a-a9f7-d00a96daf763 service nova] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-changed-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Refreshing instance network info cache due to event network-changed-44e587c3-eb25-4da8-b054-5439a13ebf51. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:24:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] Acquiring lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:24:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] Acquired lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:24:19 user nova-compute[75438]: DEBUG nova.network.neutron [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Refreshing network info cache for port 44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:24:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Stashing vm_state: active {{(pid=75438) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 09 02:24:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:20 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:24:20 user nova-compute[75438]: INFO nova.compute.claims [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Claim successful on node user
Nov 09 02:24:20 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating resource usage from migration 237f3141-0849-4b68-9ce4-bafcbf8ced44
Nov 09 02:24:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updated VIF entry in instance network info cache for port 44e587c3-eb25-4da8-b054-5439a13ebf51. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:24:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ec722947-1208-4f27-928c-4e34ce633a57 req-166697db-ed80-482b-9090-19481a01e240 service nova] Releasing lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.511s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:21 user nova-compute[75438]: INFO nova.compute.manager [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Migrating
Nov 09 02:24:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquired lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG nova.network.neutron [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Releasing lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Starting migrate_disk_and_power_off {{(pid=75438) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-dea9a5a3-2528-4005-9aa3-552246ab31f2 req-d7605f58-d585-48d1-828a-c3f60570025f service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-unplugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dea9a5a3-2528-4005-9aa3-552246ab31f2 req-d7605f58-d585-48d1-828a-c3f60570025f service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dea9a5a3-2528-4005-9aa3-552246ab31f2 req-d7605f58-d585-48d1-828a-c3f60570025f service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dea9a5a3-2528-4005-9aa3-552246ab31f2 req-d7605f58-d585-48d1-828a-c3f60570025f service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-dea9a5a3-2528-4005-9aa3-552246ab31f2 req-d7605f58-d585-48d1-828a-c3f60570025f service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-unplugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:24:22 user nova-compute[75438]: WARNING nova.compute.manager [req-dea9a5a3-2528-4005-9aa3-552246ab31f2 req-d7605f58-d585-48d1-828a-c3f60570025f service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-unplugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state active and task_state resize_migrating.
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance destroyed successfully.
Nov 09 02:24:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-674388167',display_name='tempest-ServerActionsTestOtherA-server-674388167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-674388167',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-53ezskuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:24:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=0ab2b7b0-8519-424b-b3b9-39152b4c25c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44e587c3-eb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3145dd63-5c1f-45b6-8c77-60385277b6cb) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: INFO os_vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb')
Nov 09 02:24:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b45150-1da9-4a32-8511-20da674d1b28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:24:22 user nova-compute[75438]: No targets found.
Nov 09 02:24:22 user nova-compute[75438]: iSNS:
Nov 09 02:24:22 user nova-compute[75438]: No targets found.
Nov 09 02:24:22 user nova-compute[75438]: STATIC:
Nov 09 02:24:22 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150
Nov 09 02:24:22 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:22 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:22 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:24:22 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:22 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:22 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f
Nov 09 02:24:22 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:22 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:22 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c
Nov 09 02:24:22 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:22 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:22 user nova-compute[75438]: FIRMWARE:
Nov 09 02:24:22 user nova-compute[75438]: No targets found.
Nov 09 02:24:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:24:22 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:24:22 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd96cb67-69ce-4ef7-9b74-2aca2501a0b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c26342-4463-42f7-b592-7332fd2f71c4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:22 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:22 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:24:22 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:22 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:22 user nova-compute[75438]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:24:22 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba30edbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2281fd29-ec7e-4966-9603-5e722be5191d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a7356-0b43-4923-8abb-44df7bd669e3]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ad8d2-3b80-48ef-bd01-5753b421ddb1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e955233-42dd-4a0c-bd4e-3cf0a5674975]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a99937-2ffa-4d4c-8e98-0473b9423ef2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[80148939-1dbb-403b-861d-79eb902c42ad]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]
Nov 09 02:24:22 user nova-compute[75438]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.
Nov 09 02:24:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa955fb7-158a-4465-9c5c-253adee62efc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== disconnect_volume: return (382ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-d8982c6f-bb8a-41f2-91f4-52897323d1fa req-651a64da-ab74-4875-b593-b2542628dd92 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:24:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d8982c6f-bb8a-41f2-91f4-52897323d1fa req-651a64da-ab74-4875-b593-b2542628dd92 service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d8982c6f-bb8a-41f2-91f4-52897323d1fa req-651a64da-ab74-4875-b593-b2542628dd92 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d8982c6f-bb8a-41f2-91f4-52897323d1fa req-651a64da-ab74-4875-b593-b2542628dd92 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-d8982c6f-bb8a-41f2-91f4-52897323d1fa req-651a64da-ab74-4875-b593-b2542628dd92 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:24:24 user nova-compute[75438]: WARNING nova.compute.manager [req-d8982c6f-bb8a-41f2-91f4-52897323d1fa req-651a64da-ab74-4875-b593-b2542628dd92 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state active and task_state resize_migrating.
Nov 09 02:24:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:27 user nova-compute[75438]: INFO nova.compute.manager [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Detaching volume 9a27e7ac-76cd-43a1-a2b2-eadad81f2150
Nov 09 02:24:27 user nova-compute[75438]: INFO nova.virt.block_device [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Attempting to driver detach volume 9a27e7ac-76cd-43a1-a2b2-eadad81f2150 from mountpoint /dev/vdb
Nov 09 02:24:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Attempting to detach device vdb from instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:24:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:24:27 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:27 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:24:27 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:24:27 user nova-compute[75438]:   <serial>9a27e7ac-76cd-43a1-a2b2-eadad81f2150</serial>
Nov 09 02:24:27 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:24:27 user nova-compute[75438]: </disk>
Nov 09 02:24:27 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:24:27 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully detached device vdb from instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 from the persistent domain config.
Nov 09 02:24:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:24:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:24:27 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:27 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:24:27 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:24:27 user nova-compute[75438]:   <serial>9a27e7ac-76cd-43a1-a2b2-eadad81f2150</serial>
Nov 09 02:24:27 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:24:27 user nova-compute[75438]: </disk>
Nov 09 02:24:27 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:24:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:24:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG os_brick.utils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c4e841-70ea-41ea-82b6-84abe4883273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[02951bac-26fe-4cc0-a9bb-7c7ef8f84f62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa05cf2a-7173-4c40-bf57-0fdbf2ee606f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08063ad-7b9a-4db8-adbe-ef14b089cbb8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:31 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:24:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d937188-242d-44e8-8c0b-29f90ed47069]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG os_brick.utils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:31 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating existing volume attachment record: 76261458-b42b-43ac-aeed-0b4d79327bdc {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:32 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:24:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7897MB free_disk=24.84796905517578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Applying migration context for instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 as it has an incoming, in-progress migration 237f3141-0849-4b68-9ce4-bafcbf8ced44. Migration status is migrating {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 02:24:36 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating resource usage from migration 237f3141-0849-4b68-9ce4-bafcbf8ced44
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 67e53684-8b40-4255-99a7-bfef8e644c04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 83289a7b-b6c3-443c-a4c0-613e1d06dea3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 28f31033-0b5e-4968-8641-abee31542b90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Migration 237f3141-0849-4b68-9ce4-bafcbf8ced44 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:24:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALgKrsME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:37 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:37 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:24:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a6a891-63df-4eda-8e8a-25d62ee7e252]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:24:37 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fea4db-ce9f-4e12-a7f4-2222e30d08a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e] added
Nov 09 02:24:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5741a6-c0de-4049-917d-1d8bcea03250]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188cca4-1397-4e6a-adfc-c6b1a42bc8e8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALgKrsME {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ALgKrsME" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92bf5f7-03bf-432e-9ae3-63efabf395c7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ALgKrsME'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ed167-0db6-4c6a-abc8-724e10b30057]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf97893-fb0c-4a4a-9a51-34e7b7ac9a7e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c6f808-e5bd-4c92-9a0a-bcab273be6b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260]
Nov 09 02:24:38 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260] successful.
Nov 09 02:24:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c017ba-ea9d-4ff3-aebc-ab906c03b11e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712a408-7567-4aba-9442-9d2bab8acc7b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:38 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:38 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e59796-9e75-41a5-b5d4-fcd8fbf47552]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALgKrsME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG nova.objects.instance [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'flavor' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:38 user nova-compute[75438]: INFO nova.compute.manager [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Attaching volume d6884f19-2ed0-43dc-ac68-14f49a51e8ca to /dev/vdb
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.utils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a110a56d-0e9b-4bbc-980a-d427f911bed3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[032cc92b-8165-49b8-a287-6b51456b848c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8e88b2-aa5b-4c51-bff8-832d9c86e9cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2884bebb-a8b9-4c3b-94cd-70d9aeec6365]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:38 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:24:38 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[81729b4b-0e9c-42ce-9032-491f938c8e1e]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG os_brick.utils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:38 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating existing volume attachment record: 48657c25-7eeb-40ff-bdff-08c3c1f8427c {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26335363238383961', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335363238383961', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lazy-loading 'flavor' on Instance uuid 67e53684-8b40-4255-99a7-bfef8e644c04 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:24:39 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:39 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:24:39 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:24:39 user nova-compute[75438]:   <serial>cd66b512-9b35-45f0-9c57-ffecce21d28e</serial>
Nov 09 02:24:39 user nova-compute[75438]: </disk>
Nov 09 02:24:39 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:24:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] No VIF found with MAC fa:16:3e:ca:ed:c4, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:24:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.volume.cinder [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Update attachment failed for attachment 48657c25-7eeb-40ff-bdff-08c3c1f8427c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-abfdced1-1172-44d3-97ea-7c747f2044f0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-abfdced1-1172-44d3-97ea-7c747f2044f0)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Failed to attach d6884f19-2ed0-43dc-ac68-14f49a51e8ca at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-abfdced1-1172-44d3-97ea-7c747f2044f0)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Traceback (most recent call last):
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     ret_val = method(obj, context, *args, **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     self._do_attach(context, instance, volume, volume_api,
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     self._volume_attach(context, volume, connector, instance,
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     connection_info = volume_api.attachment_update(
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     res = method(self, ctx, *args, **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     with excutils.save_and_reraise_exception():
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     self.force_reraise()
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     raise self.value
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     return method.func(obj, *args, **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     resp = self._update('/attachments/%s' % id, body)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     return self.request(url, method, **kwargs)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e]     raise exceptions.from_response(resp, body)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-abfdced1-1172-44d3-97ea-7c747f2044f0)
Nov 09 02:24:41 user nova-compute[75438]: ERROR nova.compute.manager [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] 
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cd6ce876-1804-4f7b-b295-f3186b03e8cb tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.189s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Port 44e587c3-eb25-4da8-b054-5439a13ebf51 binding to destination host user is already ACTIVE {{(pid=75438) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 3.555s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server [None req-78d733b8-e8ba-4986-b8fa-b3568312b99b tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-abfdced1-1172-44d3-97ea-7c747f2044f0)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-abfdced1-1172-44d3-97ea-7c747f2044f0)
Nov 09 02:24:42 user nova-compute[75438]: ERROR oslo_messaging.rpc.server 
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquired lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:24:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Releasing lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG os_brick.utils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3a5fcf-5138-4375-94cd-888a342683c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56948694-470d-449f-9814-0b6166ef43c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[531377ad-5efe-4666-ae55-467bfa6a95cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb1e00-c6b4-4c79-9738-33102a7f1895]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:24:43 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:24:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235373b-352f-4787-ac6a-6096e7548229]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:24:43 user nova-compute[75438]: DEBUG os_brick.utils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:44 user nova-compute[75438]: INFO nova.compute.manager [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Detaching volume cd66b512-9b35-45f0-9c57-ffecce21d28e
Nov 09 02:24:44 user nova-compute[75438]: INFO nova.virt.block_device [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Attempting to driver detach volume cd66b512-9b35-45f0-9c57-ffecce21d28e from mountpoint /dev/vdb
Nov 09 02:24:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Attempting to detach device vdb from instance 67e53684-8b40-4255-99a7-bfef8e644c04 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:24:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:24:44 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:44 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:24:44 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:24:44 user nova-compute[75438]:   <serial>cd66b512-9b35-45f0-9c57-ffecce21d28e</serial>
Nov 09 02:24:44 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:24:44 user nova-compute[75438]: </disk>
Nov 09 02:24:44 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:24:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Successfully detached device vdb from instance 67e53684-8b40-4255-99a7-bfef8e644c04 from the persistent domain config.
Nov 09 02:24:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67e53684-8b40-4255-99a7-bfef8e644c04 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:24:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:24:44 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:44 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:24:44 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:24:44 user nova-compute[75438]:   <serial>cd66b512-9b35-45f0-9c57-ffecce21d28e</serial>
Nov 09 02:24:44 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:24:44 user nova-compute[75438]: </disk>
Nov 09 02:24:44 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:24:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67e53684-8b40-4255-99a7-bfef8e644c04 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:24:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:24:48 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 is timed out.
Nov 09 02:24:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully detached device vdb from instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8 from the live domain config.
Nov 09 02:24:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNbMzjaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[49947967-9f2e-4398-91f9-4e4e8341f05f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:24:48 user nova-compute[75438]: No targets found.
Nov 09 02:24:48 user nova-compute[75438]: iSNS:
Nov 09 02:24:48 user nova-compute[75438]: No targets found.
Nov 09 02:24:48 user nova-compute[75438]: STATIC:
Nov 09 02:24:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150
Nov 09 02:24:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:24:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e
Nov 09 02:24:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c
Nov 09 02:24:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:24:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:24:48 user nova-compute[75438]: FIRMWARE:
Nov 09 02:24:48 user nova-compute[75438]: No targets found.
Nov 09 02:24:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:24:48 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:24:48 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f5d195-3402-4749-a957-d3cb0b739f08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd87221b-d0d7-4265-b678-91fde0ae1c0d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:48 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:48 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:48 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:48 user nova-compute[75438]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 (non-flash)
Nov 09 02:24:48 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:48 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba242daf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaac215-3d30-4587-a7a5-ccb1c83a30d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b498b1-e8a8-4122-aadf-9e7e9cb5df6d]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6105c-ad11-4a1d-bdc0-50568ae11f3c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe61584-82f9-429a-a5c6-482caca158e2]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae831d-b43e-432c-819a-fe93717b1ef6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251de1a-a3d6-4fbd-aec9-89152c050c63]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260]
Nov 09 02:24:48 user nova-compute[75438]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150, portal: 172.16.0.220,3260] successful.
Nov 09 02:24:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a27e7ac-76cd-43a1-a2b2-eadad81f2150 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee00a3-796a-4adc-873b-ca72de17ff45]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== disconnect_volume: return (322ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:24:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.objects.instance [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid 2efbcfcc-01ed-4773-bf45-d72ac07870e8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-914a1d15-81d3-46e0-a341-339f7105eb6d tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.363s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:24:57 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Creating image(s)
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Ensure instance console log exists: /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Start _get_guest_xml network_info=[{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '76261458-b42b-43ac-aeed-0b4d79327bdc', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '28f31033-0b5e-4968-8641-abee31542b90', 'attached_at': '', 'detached_at': '', 'volume_id': '8578f031-f819-4f70-964e-97af066593c1', 'serial': '8578f031-f819-4f70-964e-97af066593c1'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:24:57 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:24:57 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:24:57 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:57 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:24:57 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7967f1f6-4136-4ff8-a9a8-ff0d94cea702]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:24:57 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb8061-c79f-47b2-bcbe-3fc9e3615846]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1] added
Nov 09 02:24:57 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f0b658-21f3-40be-a0c7-468b0c9b3155]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[88afefc2-870a-421b-93e3-2131b93a8c13]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSMyTkYX {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSMyTkYX" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e4951-ac18-4203-979f-0ab08ff547bc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DSMyTkYX'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ba88a9-a0f9-4dc0-bcca-418a0145c90b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d6270d-7598-4367-bc4c-2c48d171f3b0]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:57 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:57 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e737666f-b9f0-4c00-a7f9-4877fc648de9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260]
Nov 09 02:24:57 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260] successful.
Nov 09 02:24:57 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab40b8-10f8-46d5-bf87-736888a487db]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e586c279-d913-41db-9301-b2405fbcc4c1]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:24:57 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:24:57 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:24:57 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a4b2ed-6d28-4fd5-b262-21c69ec2287f]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:24:57 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23833323536346632', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833323536346632', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477158708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477158708',id=36,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-b0wq3bk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:24:10Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=28f31033-0b5e-4968-8641-abee31542b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.objects.instance [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'pci_devices' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:24:59 user nova-compute[75438]:   <uuid>28f31033-0b5e-4968-8641-abee31542b90</uuid>
Nov 09 02:24:59 user nova-compute[75438]:   <name>instance-00000024</name>
Nov 09 02:24:59 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:24:59 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:24:59 user nova-compute[75438]:   <metadata>
Nov 09 02:24:59 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:24:59 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:24:59 user nova-compute[75438]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1477158708</nova:name>
Nov 09 02:24:59 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:24:57</nova:creationTime>
Nov 09 02:24:59 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:24:59 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:24:59 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:24:59 user nova-compute[75438]:       <nova:owner>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:user uuid="3160dcb696a24d3db8bd3a22064cbd7a">tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member</nova:user>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:project uuid="f7d490c388e64d5fbdeec47eb532482e">tempest-ServerBootFromVolumeStableRescueTest-1794136160</nova:project>
Nov 09 02:24:59 user nova-compute[75438]:       </nova:owner>
Nov 09 02:24:59 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:24:59 user nova-compute[75438]:       <nova:ports>
Nov 09 02:24:59 user nova-compute[75438]:         <nova:port uuid="0ca6d939-5f08-4666-8cac-bdb1abc805dc">
Nov 09 02:24:59 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:24:59 user nova-compute[75438]:         </nova:port>
Nov 09 02:24:59 user nova-compute[75438]:       </nova:ports>
Nov 09 02:24:59 user nova-compute[75438]:     </nova:instance>
Nov 09 02:24:59 user nova-compute[75438]:   </metadata>
Nov 09 02:24:59 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:24:59 user nova-compute[75438]:     <system>
Nov 09 02:24:59 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:24:59 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:24:59 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:24:59 user nova-compute[75438]:       <entry name="serial">28f31033-0b5e-4968-8641-abee31542b90</entry>
Nov 09 02:24:59 user nova-compute[75438]:       <entry name="uuid">28f31033-0b5e-4968-8641-abee31542b90</entry>
Nov 09 02:24:59 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:24:59 user nova-compute[75438]:     </system>
Nov 09 02:24:59 user nova-compute[75438]:   </sysinfo>
Nov 09 02:24:59 user nova-compute[75438]:   <os>
Nov 09 02:24:59 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:24:59 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:24:59 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:24:59 user nova-compute[75438]:   </os>
Nov 09 02:24:59 user nova-compute[75438]:   <features>
Nov 09 02:24:59 user nova-compute[75438]:     <acpi/>
Nov 09 02:24:59 user nova-compute[75438]:     <apic/>
Nov 09 02:24:59 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:24:59 user nova-compute[75438]:   </features>
Nov 09 02:24:59 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:24:59 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:24:59 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:24:59 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:24:59 user nova-compute[75438]:   </clock>
Nov 09 02:24:59 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:24:59 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:24:59 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:24:59 user nova-compute[75438]:   </cpu>
Nov 09 02:24:59 user nova-compute[75438]:   <devices>
Nov 09 02:24:59 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:24:59 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:24:59 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:24:59 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:24:59 user nova-compute[75438]:       <serial>8578f031-f819-4f70-964e-97af066593c1</serial>
Nov 09 02:24:59 user nova-compute[75438]:     </disk>
Nov 09 02:24:59 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:24:59 user nova-compute[75438]:       <mac address="fa:16:3e:e5:91:9f"/>
Nov 09 02:24:59 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:24:59 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:24:59 user nova-compute[75438]:       <target dev="tap0ca6d939-5f"/>
Nov 09 02:24:59 user nova-compute[75438]:     </interface>
Nov 09 02:24:59 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:24:59 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/console.log" append="off"/>
Nov 09 02:24:59 user nova-compute[75438]:     </serial>
Nov 09 02:24:59 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:24:59 user nova-compute[75438]:     <video>
Nov 09 02:24:59 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:24:59 user nova-compute[75438]:     </video>
Nov 09 02:24:59 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:24:59 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:24:59 user nova-compute[75438]:     </rng>
Nov 09 02:24:59 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:24:59 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:24:59 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:24:59 user nova-compute[75438]:     </memballoon>
Nov 09 02:24:59 user nova-compute[75438]:   </devices>
Nov 09 02:24:59 user nova-compute[75438]: </domain>
Nov 09 02:24:59 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477158708',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477158708',id=36,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-b0wq3bk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:24:10Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=28f31033-0b5e-4968-8641-abee31542b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG os_vif [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b8fbb15-7e48-5699-9c3d-85b9ef5a3c45', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca6d939-5f, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ca6d939-5f, col_values=(('qos', UUID('69a5a2b7-2e15-4f8a-9a2d-1f20f0a72d33')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ca6d939-5f, col_values=(('external_ids', {'iface-id': '0ca6d939-5f08-4666-8cac-bdb1abc805dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:91:9f', 'vm-uuid': '28f31033-0b5e-4968-8641-abee31542b90'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:24:59 user nova-compute[75438]: INFO os_vif [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f')
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No VIF found with MAC fa:16:3e:e5:91:9f, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:24:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-1895ab1e-f9ea-4756-867b-eada0e3c63d9 req-a39da8fb-3b75-4b45-8ca4-891a73d4f880 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1895ab1e-f9ea-4756-867b-eada0e3c63d9 req-a39da8fb-3b75-4b45-8ca4-891a73d4f880 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1895ab1e-f9ea-4756-867b-eada0e3c63d9 req-a39da8fb-3b75-4b45-8ca4-891a73d4f880 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1895ab1e-f9ea-4756-867b-eada0e3c63d9 req-a39da8fb-3b75-4b45-8ca4-891a73d4f880 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-1895ab1e-f9ea-4756-867b-eada0e3c63d9 req-a39da8fb-3b75-4b45-8ca4-891a73d4f880 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:00 user nova-compute[75438]: WARNING nova.compute.manager [req-1895ab1e-f9ea-4756-867b-eada0e3c63d9 req-a39da8fb-3b75-4b45-8ca4-891a73d4f880 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state building and task_state spawning.
Nov 09 02:25:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-6c15fb30-d94c-4952-940e-b9fc57570318 req-c97546f7-9e21-4345-885c-4af3b407920e service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6c15fb30-d94c-4952-940e-b9fc57570318 req-c97546f7-9e21-4345-885c-4af3b407920e service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6c15fb30-d94c-4952-940e-b9fc57570318 req-c97546f7-9e21-4345-885c-4af3b407920e service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6c15fb30-d94c-4952-940e-b9fc57570318 req-c97546f7-9e21-4345-885c-4af3b407920e service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-6c15fb30-d94c-4952-940e-b9fc57570318 req-c97546f7-9e21-4345-885c-4af3b407920e service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:02 user nova-compute[75438]: WARNING nova.compute.manager [req-6c15fb30-d94c-4952-940e-b9fc57570318 req-c97546f7-9e21-4345-885c-4af3b407920e service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state building and task_state spawning.
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:25:02 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance spawned successfully.
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:25:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:25:03 user nova-compute[75438]: INFO nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 09 02:25:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:25:03 user nova-compute[75438]: INFO nova.compute.manager [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Took 54.03 seconds to build instance.
Nov 09 02:25:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1faf53ae-8310-4471-96d3-6b2d47198d99 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "28f31033-0b5e-4968-8641-abee31542b90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.133s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:05 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67e53684-8b40-4255-99a7-bfef8e644c04 is timed out.
Nov 09 02:25:05 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Successfully detached device vdb from instance 67e53684-8b40-4255-99a7-bfef8e644c04 from the live domain config.
Nov 09 02:25:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ALgKrsME', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:25:05 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48eb9c-7925-4290-90cb-279e95e08e89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:25:05 user nova-compute[75438]: No targets found.
Nov 09 02:25:05 user nova-compute[75438]: iSNS:
Nov 09 02:25:05 user nova-compute[75438]: No targets found.
Nov 09 02:25:05 user nova-compute[75438]: STATIC:
Nov 09 02:25:05 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:25:05 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:05 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:05 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e
Nov 09 02:25:05 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:05 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:05 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1
Nov 09 02:25:05 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:05 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:05 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c
Nov 09 02:25:05 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:05 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:05 user nova-compute[75438]: FIRMWARE:
Nov 09 02:25:05 user nova-compute[75438]: No targets found.
Nov 09 02:25:05 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:25:05 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:25:05 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[85368057-824e-4bf3-8f1e-24489a67469b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df46153-db1e-4ea6-b3e8-f12c0c7521d9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:05 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:25:05 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:25:05 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:05 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:05 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:25:05 user nova-compute[75438]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e (non-flash)
Nov 09 02:25:05 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:05 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba044ad090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d447f2ee-52b3-4b53-b550-907960654c9b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[da47c062-0832-44c0-b026-20af97e832c5]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba6d48a-7701-4280-bd5f-0464d17d71e4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62070e20-ee65-4f54-b094-06846341833f]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae8cb54-d343-4ee4-bc9c-c6f59a02ae3b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1603d-cdfa-4c35-99b2-c823f9d07686]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260]
Nov 09 02:25:05 user nova-compute[75438]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e, portal: 172.16.0.220,3260] successful.
Nov 09 02:25:05 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd66b512-9b35-45f0-9c57-ffecce21d28e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b4b0da-76de-4bc3-9eb6-02356e7b5ed9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] <== disconnect_volume: return (428ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:25:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:06 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lazy-loading 'flavor' on Instance uuid 67e53684-8b40-4255-99a7-bfef8e644c04 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:25:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e5a039c4-be13-4d11-aabe-10501c297e06 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.141s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:18 user nova-compute[75438]: INFO nova.compute.manager [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Terminating instance
Nov 09 02:25:18 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-0384a816-a93a-4625-8c17-8234a3ec5f21 req-772f9b60-1a2d-4971-b5ee-65a01ae7f7a1 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-unplugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0384a816-a93a-4625-8c17-8234a3ec5f21 req-772f9b60-1a2d-4971-b5ee-65a01ae7f7a1 service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0384a816-a93a-4625-8c17-8234a3ec5f21 req-772f9b60-1a2d-4971-b5ee-65a01ae7f7a1 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0384a816-a93a-4625-8c17-8234a3ec5f21 req-772f9b60-1a2d-4971-b5ee-65a01ae7f7a1 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-0384a816-a93a-4625-8c17-8234a3ec5f21 req-772f9b60-1a2d-4971-b5ee-65a01ae7f7a1 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-unplugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:18 user nova-compute[75438]: DEBUG nova.compute.manager [req-0384a816-a93a-4625-8c17-8234a3ec5f21 req-772f9b60-1a2d-4971-b5ee-65a01ae7f7a1 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-unplugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Instance destroyed successfully.
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'resources' on Instance uuid 2efbcfcc-01ed-4773-bf45-d72ac07870e8 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:19:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-462279227',display_name='tempest-AttachVolumeNegativeTest-server-462279227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-462279227',id=29,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvEt5yPmql5KrwJhb2mnFD05e2OolrozjEJO4ht7hYRjgD5vcMGjCelvWEFm3cR8AbzmbwPqBxpebn6vjUGl3GqtMzowaFxN1XjzpxBGEoBYgg9Ya0QL6Il5iVTsBZe7g==',key_name='tempest-keypair-1743980706',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:19:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-s6jt94xk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:19:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=2efbcfcc-01ed-4773-bf45-d72ac07870e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "99bc17a1-de88-401d-845f-e12d919a1668", "address": "fa:16:3e:db:78:11", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99bc17a1-de", "ovs_interfaceid": "99bc17a1-de88-401d-845f-e12d919a1668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG os_vif [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99bc17a1-de, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30029f74-c7ec-4165-8031-d2bc0032e4a4) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: INFO os_vif [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:78:11,bridge_name='br-int',has_traffic_filtering=True,id=99bc17a1-de88-401d-845f-e12d919a1668,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99bc17a1-de')
Nov 09 02:25:19 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Deleting instance files /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8_del
Nov 09 02:25:19 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Deletion of /opt/stack/data/nova/instances/2efbcfcc-01ed-4773-bf45-d72ac07870e8_del complete
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: INFO nova.compute.manager [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 09 02:25:19 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:19 user nova-compute[75438]: INFO nova.compute.manager [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Terminating instance
Nov 09 02:25:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-cfa6fe04-b5d3-466c-acf4-dc428d0b6a5c req-fa08a287-ee1e-4eef-b04d-7c076434e615 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-unplugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cfa6fe04-b5d3-466c-acf4-dc428d0b6a5c req-fa08a287-ee1e-4eef-b04d-7c076434e615 service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cfa6fe04-b5d3-466c-acf4-dc428d0b6a5c req-fa08a287-ee1e-4eef-b04d-7c076434e615 service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cfa6fe04-b5d3-466c-acf4-dc428d0b6a5c req-fa08a287-ee1e-4eef-b04d-7c076434e615 service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-cfa6fe04-b5d3-466c-acf4-dc428d0b6a5c req-fa08a287-ee1e-4eef-b04d-7c076434e615 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-unplugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-cfa6fe04-b5d3-466c-acf4-dc428d0b6a5c req-fa08a287-ee1e-4eef-b04d-7c076434e615 service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-unplugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Instance destroyed successfully.
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.objects.instance [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'resources' on Instance uuid 83289a7b-b6c3-443c-a4c0-613e1d06dea3 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-876384582',display_name='tempest-TestVolumeBootPattern-server-876384582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-876384582',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:24:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-vicf20xa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:24:13Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=83289a7b-b6c3-443c-a4c0-613e1d06dea3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "a2871956-7aeb-423d-b611-3dc302445965", "address": "fa:16:3e:01:9a:e4", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2871956-7a", "ovs_interfaceid": "a2871956-7aeb-423d-b611-3dc302445965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_vif [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2871956-7a, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb1d8684-7b20-4139-a4cc-696df3b258a2) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:20 user nova-compute[75438]: INFO os_vif [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:9a:e4,bridge_name='br-int',has_traffic_filtering=True,id=a2871956-7aeb-423d-b611-3dc302445965,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2871956-7a')
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LbZNVXCA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:25:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b2627-0c82-4f5e-8d99-bbca77eef43d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:25:20 user nova-compute[75438]: No targets found.
Nov 09 02:25:20 user nova-compute[75438]: iSNS:
Nov 09 02:25:20 user nova-compute[75438]: No targets found.
Nov 09 02:25:20 user nova-compute[75438]: STATIC:
Nov 09 02:25:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:25:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1
Nov 09 02:25:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:20 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c
Nov 09 02:25:20 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:25:20 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:25:20 user nova-compute[75438]: FIRMWARE:
Nov 09 02:25:20 user nova-compute[75438]: No targets found.
Nov 09 02:25:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:25:20 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:25:20 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7a776-781d-47fe-8d7c-47284e4cc4cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[60495afb-ddeb-45a6-bea4-baff230febe9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:20 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:25:20 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:20 user nova-compute[75438]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c (non-flash)
Nov 09 02:25:20 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:20 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245b8a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:20 user nova-compute[75438]: WARNING nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received unexpected event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with vm_state active and task_state deleting.
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:20 user nova-compute[75438]: WARNING nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received unexpected event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with vm_state active and task_state deleting.
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:20 user nova-compute[75438]: WARNING nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received unexpected event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with vm_state active and task_state deleting.
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-unplugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-unplugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-2245650e-617e-40fe-a267-a6faf7feba54 req-5c474b21-918b-4239-9476-699ee6292329 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-unplugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efcb38-6dd7-4e33-be6f-7f8429c70a2e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1254d56d-5a75-4463-8e82-2a271b02a42b]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[589ec7a9-4705-4dde-972f-1cdd3e9b702b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[be47bf5b-4660-4feb-af3f-d44a5a4307af]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23732393365616233', '/dev/disk/by-id/scsi-1SCST_BIO17fe78b-7293eab3d5c23fe6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_17fe78b') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61fc955-0b91-4de2-ac78-8c919829632d]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea7cb3-cc4c-4c4e-9581-fa44ac179e17]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[45865a86-5045-4c15-8ea3-fef22a4404f4]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260]
Nov 09 02:25:21 user nova-compute[75438]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c, portal: 172.16.0.220,3260] successful.
Nov 09 02:25:21 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b54b0fc-099b-4b2d-a618-391b1c28da5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf27b76-dd2d-4788-aeb5-40be5c9a4fc7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== disconnect_volume: return (453ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:25:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Deleting instance files /opt/stack/data/nova/instances/83289a7b-b6c3-443c-a4c0-613e1d06dea3_del
Nov 09 02:25:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Deletion of /opt/stack/data/nova/instances/83289a7b-b6c3-443c-a4c0-613e1d06dea3_del complete
Nov 09 02:25:21 user nova-compute[75438]: INFO nova.compute.manager [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:25:21 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Took 1.84 seconds to deallocate network for instance.
Nov 09 02:25:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:21 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Deleted allocations for instance 2efbcfcc-01ed-4773-bf45-d72ac07870e8
Nov 09 02:25:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:25:21 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Took 0.78 seconds to deallocate network for instance.
Nov 09 02:25:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c828b9d6-2ffe-4f3b-a36d-fe5749d00a06 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.661s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received unexpected event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with vm_state active and task_state deleting.
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received unexpected event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with vm_state active and task_state deleting.
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received unexpected event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with vm_state active and task_state deleting.
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-unplugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-unplugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-unplugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Acquiring lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] No waiting events found dispatching network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received unexpected event network-vif-plugged-a2871956-7aeb-423d-b611-3dc302445965 for instance with vm_state active and task_state deleting.
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-59719898-c713-4268-ae64-4289d2bc3a03 req-ad841f59-a231-417a-9108-8471e0b9734a service nova] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Received event network-vif-deleted-a2871956-7aeb-423d-b611-3dc302445965 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Starting finish_migration {{(pid=75438) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:25:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Creating image(s)
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab2b7b0-8519-424b-b3b9-39152b4c25c1/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Start _get_guest_xml network_info=[{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '6c6da1b6-7c8b-4440-9159-baf610d04164', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0ab2b7b0-8519-424b-b3b9-39152b4c25c1', 'attached_at': '2023-11-09T02:25:22.000000', 'detached_at': '', 'volume_id': 'c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'serial': 'c58efce2-07e1-4947-b9fe-94da4ddc6a2f'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:25:22 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7331f9-341e-4a2e-8097-b81e751fb27a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:25:22 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a25109-9fe8-40bc-afeb-934be3beaa84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f] added
Nov 09 02:25:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcea3cd-e206-40f3-a181-17d4c3a77543]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99876d7-01da-4f34-8003-ce4b59fdc750]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtYWyQTg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtYWyQTg" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe7c7b-1fc8-41b2-8f15-a318777b1453]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtYWyQTg'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[281e8d20-75c7-4fc9-852a-2e56eb5acd28]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb61594-2656-43e9-b096-9ec536416b66]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9cfc5a-cf88-4885-a146-c8e490ecb36e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]
Nov 09 02:25:22 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.
Nov 09 02:25:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0913efd-21e2-4583-b652-d0219af4b7ae]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ba8002-d657-4cd5-b410-da0512689d2e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:25:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:25:22 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:25:22 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] Acquiring lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] Lock "2efbcfcc-01ed-4773-bf45-d72ac07870e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] No waiting events found dispatching network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:22 user nova-compute[75438]: WARNING nova.compute.manager [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received unexpected event network-vif-plugged-99bc17a1-de88-401d-845f-e12d919a1668 for instance with vm_state deleted and task_state None.
Nov 09 02:25:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-c1cff9e3-eb98-4624-8369-385b8b0c1008 req-843ca4e1-0eba-47ed-bfb7-cd58cb9a3a29 service nova] [instance: 2efbcfcc-01ed-4773-bf45-d72ac07870e8] Received event network-vif-deleted-99bc17a1-de88-401d-845f-e12d919a1668 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.116s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d4f87-4ec9-4ea9-89d1-b32912030859]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:25:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:25:23 user nova-compute[75438]: INFO nova.compute.manager [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Took 1.36 seconds to detach 1 volumes for instance.
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 83289a7b-b6c3-443c-a4c0-613e1d06dea3] Deleting volume: 8b54b0fc-099b-4b2d-a618-391b1c28da5c {{(pid=75438) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '26633356666633837', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633356666633837', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-674388167',display_name='tempest-ServerActionsTestOtherA-server-674388167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-674388167',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-53ezskuj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=0ab2b7b0-8519-424b-b3b9-39152b4c25c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:25:23 user nova-compute[75438]:   <uuid>0ab2b7b0-8519-424b-b3b9-39152b4c25c1</uuid>
Nov 09 02:25:23 user nova-compute[75438]:   <name>instance-0000001f</name>
Nov 09 02:25:23 user nova-compute[75438]:   <memory>2097152</memory>
Nov 09 02:25:23 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:25:23 user nova-compute[75438]:   <metadata>
Nov 09 02:25:23 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:25:23 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:25:23 user nova-compute[75438]:       <nova:name>tempest-ServerActionsTestOtherA-server-674388167</nova:name>
Nov 09 02:25:23 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:25:22</nova:creationTime>
Nov 09 02:25:23 user nova-compute[75438]:       <nova:flavor name="m1.small">
Nov 09 02:25:23 user nova-compute[75438]:         <nova:memory>2048</nova:memory>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:disk>20</nova:disk>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:25:23 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:25:23 user nova-compute[75438]:       <nova:owner>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:user uuid="e95d2465b0af4dcab397b5ccc2809c59">tempest-ServerActionsTestOtherA-1813489270-project-member</nova:user>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:project uuid="7a4b29710bb14b8fb9714109aec43dc6">tempest-ServerActionsTestOtherA-1813489270</nova:project>
Nov 09 02:25:23 user nova-compute[75438]:       </nova:owner>
Nov 09 02:25:23 user nova-compute[75438]:       <nova:ports>
Nov 09 02:25:23 user nova-compute[75438]:         <nova:port uuid="44e587c3-eb25-4da8-b054-5439a13ebf51">
Nov 09 02:25:23 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:25:23 user nova-compute[75438]:         </nova:port>
Nov 09 02:25:23 user nova-compute[75438]:       </nova:ports>
Nov 09 02:25:23 user nova-compute[75438]:     </nova:instance>
Nov 09 02:25:23 user nova-compute[75438]:   </metadata>
Nov 09 02:25:23 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:25:23 user nova-compute[75438]:     <system>
Nov 09 02:25:23 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:25:23 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:25:23 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:25:23 user nova-compute[75438]:       <entry name="serial">0ab2b7b0-8519-424b-b3b9-39152b4c25c1</entry>
Nov 09 02:25:23 user nova-compute[75438]:       <entry name="uuid">0ab2b7b0-8519-424b-b3b9-39152b4c25c1</entry>
Nov 09 02:25:23 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:25:23 user nova-compute[75438]:     </system>
Nov 09 02:25:23 user nova-compute[75438]:   </sysinfo>
Nov 09 02:25:23 user nova-compute[75438]:   <os>
Nov 09 02:25:23 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:25:23 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:25:23 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:25:23 user nova-compute[75438]:   </os>
Nov 09 02:25:23 user nova-compute[75438]:   <features>
Nov 09 02:25:23 user nova-compute[75438]:     <acpi/>
Nov 09 02:25:23 user nova-compute[75438]:     <apic/>
Nov 09 02:25:23 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:25:23 user nova-compute[75438]:   </features>
Nov 09 02:25:23 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:25:23 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:25:23 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:25:23 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:25:23 user nova-compute[75438]:   </clock>
Nov 09 02:25:23 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:25:23 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:25:23 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:25:23 user nova-compute[75438]:   </cpu>
Nov 09 02:25:23 user nova-compute[75438]:   <devices>
Nov 09 02:25:23 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:25:23 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:25:23 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:25:23 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:25:23 user nova-compute[75438]:       <serial>c58efce2-07e1-4947-b9fe-94da4ddc6a2f</serial>
Nov 09 02:25:23 user nova-compute[75438]:     </disk>
Nov 09 02:25:23 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:25:23 user nova-compute[75438]:       <mac address="fa:16:3e:36:6c:75"/>
Nov 09 02:25:23 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:25:23 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:25:23 user nova-compute[75438]:       <target dev="tap44e587c3-eb"/>
Nov 09 02:25:23 user nova-compute[75438]:     </interface>
Nov 09 02:25:23 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:25:23 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/0ab2b7b0-8519-424b-b3b9-39152b4c25c1/console.log" append="off"/>
Nov 09 02:25:23 user nova-compute[75438]:     </serial>
Nov 09 02:25:23 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:25:23 user nova-compute[75438]:     <video>
Nov 09 02:25:23 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:25:23 user nova-compute[75438]:     </video>
Nov 09 02:25:23 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:25:23 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:25:23 user nova-compute[75438]:     </rng>
Nov 09 02:25:23 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:25:23 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:25:23 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:25:23 user nova-compute[75438]:     </memballoon>
Nov 09 02:25:23 user nova-compute[75438]:   </devices>
Nov 09 02:25:23 user nova-compute[75438]: </domain>
Nov 09 02:25:23 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-674388167',display_name='tempest-ServerActionsTestOtherA-server-674388167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-674388167',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:23:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-53ezskuj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:24:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=0ab2b7b0-8519-424b-b3b9-39152b4c25c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-886521914-network", "vif_mac": "fa:16:3e:36:6c:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG os_vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '183ca3fc-fdaf-5ad4-9f81-89d4e2e9c14f', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:23 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Deleted allocations for instance 83289a7b-b6c3-443c-a4c0-613e1d06dea3
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44e587c3-eb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44e587c3-eb, col_values=(('qos', UUID('244045fa-2439-4e67-913c-3748989fa10b')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44e587c3-eb, col_values=(('external_ids', {'iface-id': '44e587c3-eb25-4da8-b054-5439a13ebf51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:6c:75', 'vm-uuid': '0ab2b7b0-8519-424b-b3b9-39152b4c25c1'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:23 user nova-compute[75438]: INFO os_vif [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb')
Nov 09 02:25:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:25:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] No VIF found with MAC fa:16:3e:36:6c:75, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:25:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-dc4a5580-7884-4569-bc46-62a7bb01340f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "83289a7b-b6c3-443c-a4c0-613e1d06dea3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.348s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-abc1bcc4-1841-42fa-85e7-c153e74dcd46 req-7fb9ffc9-d521-4fa9-8c14-68862b9240b5 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-abc1bcc4-1841-42fa-85e7-c153e74dcd46 req-7fb9ffc9-d521-4fa9-8c14-68862b9240b5 service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-abc1bcc4-1841-42fa-85e7-c153e74dcd46 req-7fb9ffc9-d521-4fa9-8c14-68862b9240b5 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-abc1bcc4-1841-42fa-85e7-c153e74dcd46 req-7fb9ffc9-d521-4fa9-8c14-68862b9240b5 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-abc1bcc4-1841-42fa-85e7-c153e74dcd46 req-7fb9ffc9-d521-4fa9-8c14-68862b9240b5 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:25 user nova-compute[75438]: WARNING nova.compute.manager [req-abc1bcc4-1841-42fa-85e7-c153e74dcd46 req-7fb9ffc9-d521-4fa9-8c14-68862b9240b5 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state active and task_state resize_finish.
Nov 09 02:25:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4699b1e-d0e9-458c-9e83-b39f739a3e28 req-d31a08df-99ed-4f3c-b732-49ac44c6fc14 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4699b1e-d0e9-458c-9e83-b39f739a3e28 req-d31a08df-99ed-4f3c-b732-49ac44c6fc14 service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4699b1e-d0e9-458c-9e83-b39f739a3e28 req-d31a08df-99ed-4f3c-b732-49ac44c6fc14 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4699b1e-d0e9-458c-9e83-b39f739a3e28 req-d31a08df-99ed-4f3c-b732-49ac44c6fc14 service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4699b1e-d0e9-458c-9e83-b39f739a3e28 req-d31a08df-99ed-4f3c-b732-49ac44c6fc14 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:27 user nova-compute[75438]: WARNING nova.compute.manager [req-a4699b1e-d0e9-458c-9e83-b39f739a3e28 req-d31a08df-99ed-4f3c-b732-49ac44c6fc14 service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state active and task_state resize_finish.
Nov 09 02:25:27 user nova-compute[75438]: DEBUG nova.compute.manager [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:25:27 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance running successfully.
Nov 09 02:25:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Failed to set time: agent not configured {{(pid=75438) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 09 02:25:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-17a19927-5f38-4d98-b7d1-52a4ffeb000c tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] finish_migration finished successfully. {{(pid=75438) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 09 02:25:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:25:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid e2cc1833-7812-4534-aa5a-b793f37b5254 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [{"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-e2cc1833-7812-4534-aa5a-b793f37b5254" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:25:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:25:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=24.869983673095703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Applying migration context for instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 as it has an incoming, in-progress migration 237f3141-0849-4b68-9ce4-bafcbf8ced44. Migration status is finished {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 02:25:36 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating resource usage from migration 237f3141-0849-4b68-9ce4-bafcbf8ced44
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 67e53684-8b40-4255-99a7-bfef8e644c04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 28f31033-0b5e-4968-8641-abee31542b90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Migration 237f3141-0849-4b68-9ce4-bafcbf8ced44 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:25:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:25:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:46 user nova-compute[75438]: INFO nova.compute.manager [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Terminating instance
Nov 09 02:25:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:25:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-dbfcbfa8-5a7b-488e-90c2-75ce1b73733e req-68389aa3-e18f-47d0-be7f-8d9f904c8c02 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-unplugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dbfcbfa8-5a7b-488e-90c2-75ce1b73733e req-68389aa3-e18f-47d0-be7f-8d9f904c8c02 service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dbfcbfa8-5a7b-488e-90c2-75ce1b73733e req-68389aa3-e18f-47d0-be7f-8d9f904c8c02 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dbfcbfa8-5a7b-488e-90c2-75ce1b73733e req-68389aa3-e18f-47d0-be7f-8d9f904c8c02 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-dbfcbfa8-5a7b-488e-90c2-75ce1b73733e req-68389aa3-e18f-47d0-be7f-8d9f904c8c02 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-unplugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-dbfcbfa8-5a7b-488e-90c2-75ce1b73733e req-68389aa3-e18f-47d0-be7f-8d9f904c8c02 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-unplugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Instance destroyed successfully.
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lazy-loading 'resources' on Instance uuid 67e53684-8b40-4255-99a7-bfef8e644c04 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:22:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-298335707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2983357',id=33,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6gsZJswzoWOXEdmk289ffSmtPiJKNZba0nKih1GKsMEgpVe6qN0QbO6nvrUzXeCsWUUiovIq18HNMzWPpCRox5LB0b4QcV6YPI1Nf1E+Nz2EycNuPyItusgM0WmR/SOA==',key_name='tempest-keypair-1739225489',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18f0ec2f816d4c7bb8c29bc5987f73d9',ramdisk_id='',reservation_id='r-iy2s79a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1794109058',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='379247c2ddac45cca6c36c7683e2f811',uuid=67e53684-8b40-4255-99a7-bfef8e644c04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Converting VIF {"id": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "address": "fa:16:3e:ca:ed:c4", "network": {"id": "ac8c4081-9575-4fe9-ae76-8e4011113de3", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-917535849-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18f0ec2f816d4c7bb8c29bc5987f73d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d094d5-d2", "ovs_interfaceid": "e3d094d5-d281-4ef3-a491-9e87a7c50d2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG os_vif [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3d094d5-d2, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a61d118-898a-4999-9b9c-0231bfbb818d) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:47 user nova-compute[75438]: INFO os_vif [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:ed:c4,bridge_name='br-int',has_traffic_filtering=True,id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a,network=Network(ac8c4081-9575-4fe9-ae76-8e4011113de3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d094d5-d2')
Nov 09 02:25:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Deleting instance files /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04_del
Nov 09 02:25:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Deletion of /opt/stack/data/nova/instances/67e53684-8b40-4255-99a7-bfef8e644c04_del complete
Nov 09 02:25:47 user nova-compute[75438]: INFO nova.compute.manager [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 09 02:25:47 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:25:47 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:25:48 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Took 0.83 seconds to deallocate network for instance.
Nov 09 02:25:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-1b6ce81b-57f7-4593-acc1-60957208e7e7 req-d177b2ba-f6d8-49ce-b36a-8fa4155da8a8 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-deleted-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:48 user nova-compute[75438]: INFO nova.compute.manager [req-1b6ce81b-57f7-4593-acc1-60957208e7e7 req-d177b2ba-f6d8-49ce-b36a-8fa4155da8a8 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Neutron deleted interface e3d094d5-d281-4ef3-a491-9e87a7c50d2a; detaching it from the instance and deleting it from the info cache
Nov 09 02:25:48 user nova-compute[75438]: DEBUG nova.network.neutron [req-1b6ce81b-57f7-4593-acc1-60957208e7e7 req-d177b2ba-f6d8-49ce-b36a-8fa4155da8a8 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-1b6ce81b-57f7-4593-acc1-60957208e7e7 req-d177b2ba-f6d8-49ce-b36a-8fa4155da8a8 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Detach interface failed, port_id=e3d094d5-d281-4ef3-a491-9e87a7c50d2a, reason: Instance 67e53684-8b40-4255-99a7-bfef8e644c04 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:49 user nova-compute[75438]: WARNING nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state deleted and task_state None.
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:49 user nova-compute[75438]: WARNING nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state deleted and task_state None.
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:49 user nova-compute[75438]: WARNING nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state deleted and task_state None.
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-unplugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-unplugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:49 user nova-compute[75438]: WARNING nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-unplugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state deleted and task_state None.
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Acquiring lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] Lock "67e53684-8b40-4255-99a7-bfef8e644c04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] No waiting events found dispatching network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:25:49 user nova-compute[75438]: WARNING nova.compute.manager [req-e354bfa0-a091-4512-ab22-fa403cb09155 req-e7c5b261-c2b6-4c17-bd8c-3ef3258494e1 service nova] [instance: 67e53684-8b40-4255-99a7-bfef8e644c04] Received unexpected event network-vif-plugged-e3d094d5-d281-4ef3-a491-9e87a7c50d2a for instance with vm_state deleted and task_state None.
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:49 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Deleted allocations for instance 67e53684-8b40-4255-99a7-bfef8e644c04
Nov 09 02:25:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a8f48ab8-201f-46d1-adda-38fbc323b7da tempest-TestServerVolumeAttachScenarioOldVersion-1794109058 tempest-TestServerVolumeAttachScenarioOldVersion-1794109058-project-member] Lock "67e53684-8b40-4255-99a7-bfef8e644c04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:25:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:25:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:26:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:26:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:26:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:26:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:26:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:12 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:26:12 user nova-compute[75438]: INFO nova.compute.claims [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Claim successful on node user
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:26:13 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.policy [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f241dbd509b4beb8148222f8379d58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374722030e844844b670f169c722977c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:26:13 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Creating image(s)
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk 1073741824" returned: 0 in 0.059s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Successfully created port: 0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Cannot resize image /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Ensure instance console log exists: /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Successfully updated port: 0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquired lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-changed-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Refreshing instance network info cache due to event network-changed-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] Acquiring lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updating instance_info_cache with network_info: [{"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Releasing lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Instance network_info: |[{"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] Acquired lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Refreshing network info cache for port 0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Start _get_guest_xml network_info=[{"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:26:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:26:15 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-111841088',display_name='tempest-AttachVolumeNegativeTest-server-111841088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-111841088',id=37,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lCZUJa2muuKIDPKWXyl40H7ylfdJ+Eambb3ztDQNmONDYf9MApmvu5dZpkw4TZD9QmEa1DWp3+9haOt9+iMW4Fht2flO2bY+WnKHVxlXNikJbNlL3cpqXMdReI3KGaw==',key_name='tempest-keypair-1005296627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-n0xhnmp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=e1a0f4aa-e857-45f4-84e8-0c973556d402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.objects.instance [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'pci_devices' on Instance uuid e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:26:15 user nova-compute[75438]:   <uuid>e1a0f4aa-e857-45f4-84e8-0c973556d402</uuid>
Nov 09 02:26:15 user nova-compute[75438]:   <name>instance-00000025</name>
Nov 09 02:26:15 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:26:15 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:26:15 user nova-compute[75438]:   <metadata>
Nov 09 02:26:15 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:26:15 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:26:15 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeNegativeTest-server-111841088</nova:name>
Nov 09 02:26:15 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:26:15</nova:creationTime>
Nov 09 02:26:15 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:26:15 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:26:15 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:26:15 user nova-compute[75438]:       <nova:owner>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:user uuid="1f241dbd509b4beb8148222f8379d58e">tempest-AttachVolumeNegativeTest-1037659816-project-member</nova:user>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:project uuid="374722030e844844b670f169c722977c">tempest-AttachVolumeNegativeTest-1037659816</nova:project>
Nov 09 02:26:15 user nova-compute[75438]:       </nova:owner>
Nov 09 02:26:15 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:26:15 user nova-compute[75438]:       <nova:ports>
Nov 09 02:26:15 user nova-compute[75438]:         <nova:port uuid="0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f">
Nov 09 02:26:15 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 09 02:26:15 user nova-compute[75438]:         </nova:port>
Nov 09 02:26:15 user nova-compute[75438]:       </nova:ports>
Nov 09 02:26:15 user nova-compute[75438]:     </nova:instance>
Nov 09 02:26:15 user nova-compute[75438]:   </metadata>
Nov 09 02:26:15 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:26:15 user nova-compute[75438]:     <system>
Nov 09 02:26:15 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:26:15 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:26:15 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:26:15 user nova-compute[75438]:       <entry name="serial">e1a0f4aa-e857-45f4-84e8-0c973556d402</entry>
Nov 09 02:26:15 user nova-compute[75438]:       <entry name="uuid">e1a0f4aa-e857-45f4-84e8-0c973556d402</entry>
Nov 09 02:26:15 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:26:15 user nova-compute[75438]:     </system>
Nov 09 02:26:15 user nova-compute[75438]:   </sysinfo>
Nov 09 02:26:15 user nova-compute[75438]:   <os>
Nov 09 02:26:15 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:26:15 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:26:15 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:26:15 user nova-compute[75438]:   </os>
Nov 09 02:26:15 user nova-compute[75438]:   <features>
Nov 09 02:26:15 user nova-compute[75438]:     <acpi/>
Nov 09 02:26:15 user nova-compute[75438]:     <apic/>
Nov 09 02:26:15 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:26:15 user nova-compute[75438]:   </features>
Nov 09 02:26:15 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:26:15 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:26:15 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:26:15 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:26:15 user nova-compute[75438]:   </clock>
Nov 09 02:26:15 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:26:15 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:26:15 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:26:15 user nova-compute[75438]:   </cpu>
Nov 09 02:26:15 user nova-compute[75438]:   <devices>
Nov 09 02:26:15 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:26:15 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:26:15 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk"/>
Nov 09 02:26:15 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:26:15 user nova-compute[75438]:     </disk>
Nov 09 02:26:15 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:26:15 user nova-compute[75438]:       <mac address="fa:16:3e:62:dc:70"/>
Nov 09 02:26:15 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:26:15 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:26:15 user nova-compute[75438]:       <target dev="tap0dea5bf1-3d"/>
Nov 09 02:26:15 user nova-compute[75438]:     </interface>
Nov 09 02:26:15 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:26:15 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/console.log" append="off"/>
Nov 09 02:26:15 user nova-compute[75438]:     </serial>
Nov 09 02:26:15 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:26:15 user nova-compute[75438]:     <video>
Nov 09 02:26:15 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:26:15 user nova-compute[75438]:     </video>
Nov 09 02:26:15 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:26:15 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:26:15 user nova-compute[75438]:     </rng>
Nov 09 02:26:15 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:26:15 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:26:15 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:26:15 user nova-compute[75438]:     </memballoon>
Nov 09 02:26:15 user nova-compute[75438]:   </devices>
Nov 09 02:26:15 user nova-compute[75438]: </domain>
Nov 09 02:26:15 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-111841088',display_name='tempest-AttachVolumeNegativeTest-server-111841088',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-111841088',id=37,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lCZUJa2muuKIDPKWXyl40H7ylfdJ+Eambb3ztDQNmONDYf9MApmvu5dZpkw4TZD9QmEa1DWp3+9haOt9+iMW4Fht2flO2bY+WnKHVxlXNikJbNlL3cpqXMdReI3KGaw==',key_name='tempest-keypair-1005296627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-n0xhnmp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=e1a0f4aa-e857-45f4-84e8-0c973556d402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG os_vif [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0467a1b1-c81e-54ca-bff4-6268dfff1765', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dea5bf1-3d, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0dea5bf1-3d, col_values=(('qos', UUID('34149ae4-84f2-4a8a-90b0-5250448a781b')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0dea5bf1-3d, col_values=(('external_ids', {'iface-id': '0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:dc:70', 'vm-uuid': 'e1a0f4aa-e857-45f4-84e8-0c973556d402'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:15 user nova-compute[75438]: INFO os_vif [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d')
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:62:dc:70, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updated VIF entry in instance network info cache for port 0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updating instance_info_cache with network_info: [{"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:26:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5c09e460-9f71-4fed-ba25-75575fabeb2b req-3ddf68b4-9e38-4474-a47d-dab695de9e69 service nova] Releasing lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-fbe53e13-7a51-40b1-9476-0df4d8266fbd req-a3b0cc22-58ed-4bdf-b5eb-1d6eef1d007f service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fbe53e13-7a51-40b1-9476-0df4d8266fbd req-a3b0cc22-58ed-4bdf-b5eb-1d6eef1d007f service nova] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fbe53e13-7a51-40b1-9476-0df4d8266fbd req-a3b0cc22-58ed-4bdf-b5eb-1d6eef1d007f service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fbe53e13-7a51-40b1-9476-0df4d8266fbd req-a3b0cc22-58ed-4bdf-b5eb-1d6eef1d007f service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-fbe53e13-7a51-40b1-9476-0df4d8266fbd req-a3b0cc22-58ed-4bdf-b5eb-1d6eef1d007f service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] No waiting events found dispatching network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:26:17 user nova-compute[75438]: WARNING nova.compute.manager [req-fbe53e13-7a51-40b1-9476-0df4d8266fbd req-a3b0cc22-58ed-4bdf-b5eb-1d6eef1d007f service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received unexpected event network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f for instance with vm_state building and task_state spawning.
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:26:19 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Instance spawned successfully.
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-24004068-25e4-4baa-b12e-452570674001 req-753d837a-b5a6-476d-94b5-22f4299f3450 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24004068-25e4-4baa-b12e-452570674001 req-753d837a-b5a6-476d-94b5-22f4299f3450 service nova] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24004068-25e4-4baa-b12e-452570674001 req-753d837a-b5a6-476d-94b5-22f4299f3450 service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-24004068-25e4-4baa-b12e-452570674001 req-753d837a-b5a6-476d-94b5-22f4299f3450 service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.compute.manager [req-24004068-25e4-4baa-b12e-452570674001 req-753d837a-b5a6-476d-94b5-22f4299f3450 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] No waiting events found dispatching network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:26:19 user nova-compute[75438]: WARNING nova.compute.manager [req-24004068-25e4-4baa-b12e-452570674001 req-753d837a-b5a6-476d-94b5-22f4299f3450 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received unexpected event network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f for instance with vm_state building and task_state spawning.
Nov 09 02:26:19 user nova-compute[75438]: INFO nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 09 02:26:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:26:19 user nova-compute[75438]: INFO nova.compute.manager [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Took 6.58 seconds to build instance.
Nov 09 02:26:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-11633f91-7256-4f82-b7fe-f680fa9db37e tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:26:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:26:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:26:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:26:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:26:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:26:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:26:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:26:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:26:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:26:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7985MB free_disk=24.851238250732422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Applying migration context for instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 as it has an incoming, in-progress migration 237f3141-0849-4b68-9ce4-bafcbf8ced44. Migration status is finished {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 09 02:26:37 user nova-compute[75438]: INFO nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating resource usage from migration 237f3141-0849-4b68-9ce4-bafcbf8ced44
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 28f31033-0b5e-4968-8641-abee31542b90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Migration 237f3141-0849-4b68-9ce4-bafcbf8ced44 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e1a0f4aa-e857-45f4-84e8-0c973556d402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:26:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:26:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:26:50 user nova-compute[75438]: INFO nova.compute.manager [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Rescuing
Nov 09 02:26:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:26:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:26:50 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:26:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating instance_info_cache with network_info: [{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-78b45c14-a58d-4b31-bf43-794168b34b3b req-f3568a4c-20a3-43ae-b927-7f86fea852f0 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-78b45c14-a58d-4b31-bf43-794168b34b3b req-f3568a4c-20a3-43ae-b927-7f86fea852f0 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-78b45c14-a58d-4b31-bf43-794168b34b3b req-f3568a4c-20a3-43ae-b927-7f86fea852f0 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-78b45c14-a58d-4b31-bf43-794168b34b3b req-f3568a4c-20a3-43ae-b927-7f86fea852f0 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-78b45c14-a58d-4b31-bf43-794168b34b3b req-f3568a4c-20a3-43ae-b927-7f86fea852f0 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:26:51 user nova-compute[75438]: WARNING nova.compute.manager [req-78b45c14-a58d-4b31-bf43-794168b34b3b req-f3568a4c-20a3-43ae-b927-7f86fea852f0 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state active and task_state rescuing.
Nov 09 02:26:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance destroyed successfully.
Nov 09 02:26:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Attempting a stable device rescue
Nov 09 02:26:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75438) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 09 02:26:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance directory exists: not creating {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 09 02:26:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Creating image(s)
Nov 09 02:26:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "/opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "/opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'trusted_certs' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "c456ae7451d63141e3102b3ef01d52b503a4b4e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "c456ae7451d63141e3102b3ef01d52b503a4b4e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.part --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG nova.virt.images [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] a02e33f8-bcc6-40b0-92a4-8140ae23d461 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.part /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-730b5056-6a3c-4fb4-b062-5a4ec0d9511a req-0451a7c7-05fb-4be9-bee3-ca5fff83a5b9 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-730b5056-6a3c-4fb4-b062-5a4ec0d9511a req-0451a7c7-05fb-4be9-bee3-ca5fff83a5b9 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-730b5056-6a3c-4fb4-b062-5a4ec0d9511a req-0451a7c7-05fb-4be9-bee3-ca5fff83a5b9 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-730b5056-6a3c-4fb4-b062-5a4ec0d9511a req-0451a7c7-05fb-4be9-bee3-ca5fff83a5b9 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-730b5056-6a3c-4fb4-b062-5a4ec0d9511a req-0451a7c7-05fb-4be9-bee3-ca5fff83a5b9 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:26:53 user nova-compute[75438]: WARNING nova.compute.manager [req-730b5056-6a3c-4fb4-b062-5a4ec0d9511a req-0451a7c7-05fb-4be9-bee3-ca5fff83a5b9 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state active and task_state rescuing.
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.part /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.converted" returned: 0 in 0.531s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "c456ae7451d63141e3102b3ef01d52b503a4b4e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.093s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "c456ae7451d63141e3102b3ef01d52b503a4b4e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "c456ae7451d63141e3102b3ef01d52b503a4b4e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1 --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1,backing_fmt=raw /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1,backing_fmt=raw /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue" returned: 0 in 0.049s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "c456ae7451d63141e3102b3ef01d52b503a4b4e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'migration_context' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<28f31033-0b5e-4968-8641-abee31542b90> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Start _get_guest_xml network_info=[{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "vif_mac": "fa:16:3e:e5:91:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a02e33f8-bcc6-40b0-92a4-8140ae23d461', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '76261458-b42b-43ac-aeed-0b4d79327bdc', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '28f31033-0b5e-4968-8641-abee31542b90', 'attached_at': '', 'detached_at': '', 'volume_id': '8578f031-f819-4f70-964e-97af066593c1', 'serial': '8578f031-f819-4f70-964e-97af066593c1'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'resources' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<28f31033-0b5e-4968-8641-abee31542b90> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'numa_topology' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<28f31033-0b5e-4968-8641-abee31542b90> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:26:54 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:26:54 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<28f31033-0b5e-4968-8641-abee31542b90> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:26:54 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:26:54 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:26:54 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66d6519-eb9a-4670-a2d7-ef5c567c6070]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DSMyTkYX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 09 02:26:54 user nova-compute[75438]: node.name = iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1
Nov 09 02:26:54 user nova-compute[75438]: node.tpgt = -1
Nov 09 02:26:54 user nova-compute[75438]: node.startup = automatic
Nov 09 02:26:54 user nova-compute[75438]: node.leading_login = No
Nov 09 02:26:54 user nova-compute[75438]: iface.iscsi_ifacename = default
Nov 09 02:26:54 user nova-compute[75438]: iface.net_ifacename = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.ipaddress = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.prefix_len = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.hwaddress = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.transport_name = tcp
Nov 09 02:26:54 user nova-compute[75438]: iface.initiatorname = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.vlan_id = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.vlan_priority = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.vlan_state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.iface_num = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.mtu = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.port = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.bootproto = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.subnet_mask = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.gateway = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_alt_client_id_state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_alt_client_id = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_dns = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_learn_iqn = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_req_vendor_id_state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_vendor_id_state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_vendor_id = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.dhcp_slp_da = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.fragmentation = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.gratuitous_arp = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.incoming_forwarding = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.tos_state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.tos = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.ttl = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.delayed_ack = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.tcp_nagle = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.tcp_wsf_state = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.tcp_wsf = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.tcp_timer_scale = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.tcp_timestamp = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.redirect = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.def_task_mgmt_timeout = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.header_digest = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.data_digest = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.immediate_data = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.initial_r2t = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.data_seq_inorder = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.data_pdu_inorder = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.erl = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.max_receive_data_len = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.first_burst_len = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.max_outstanding_r2t = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.max_burst_len = 0
Nov 09 02:26:54 user nova-compute[75438]: iface.chap_auth = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.bidi_chap = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.strict_login_compliance = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.discovery_auth = <empty>
Nov 09 02:26:54 user nova-compute[75438]: iface.discovery_logout = <empty>
Nov 09 02:26:54 user nova-compute[75438]: node.discovery_address = <empty>
Nov 09 02:26:54 user nova-compute[75438]: node.discovery_port = 0
Nov 09 02:26:54 user nova-compute[75438]: node.discovery_type = static
Nov 09 02:26:54 user nova-compute[75438]: node.session.initial_cmdsn = 0
Nov 09 02:26:54 user nova-compute[75438]: node.session.initial_login_retry_max = 8
Nov 09 02:26:54 user nova-compute[75438]: node.session.xmit_thread_priority = -20
Nov 09 02:26:54 user nova-compute[75438]: node.session.cmds_max = 128
Nov 09 02:26:54 user nova-compute[75438]: node.session.queue_depth = 32
Nov 09 02:26:54 user nova-compute[75438]: node.session.nr_sessions = 1
Nov 09 02:26:54 user nova-compute[75438]: node.session.auth.authmethod = CHAP
Nov 09 02:26:54 user nova-compute[75438]: node.session.auth.username = DSMyTkYX
Nov 09 02:26:54 user nova-compute[75438]: node.session.auth.password = ***
Nov 09 02:26:54 user nova-compute[75438]: node.session.auth.username_in = <empty>
Nov 09 02:26:54 user nova-compute[75438]: node.session.auth.password_in = <empty>
Nov 09 02:26:54 user nova-compute[75438]: node.session.auth.chap_algs = MD5
Nov 09 02:26:54 user nova-compute[75438]: node.session.timeo.replacement_timeout = 120
Nov 09 02:26:54 user nova-compute[75438]: node.session.err_timeo.abort_timeout = 15
Nov 09 02:26:54 user nova-compute[75438]: node.session.err_timeo.lu_reset_timeout = 30
Nov 09 02:26:54 user nova-compute[75438]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 09 02:26:54 user nova-compute[75438]: node.session.err_timeo.host_reset_timeout = 60
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.FastAbort = Yes
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.InitialR2T = No
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.ImmediateData = Yes
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.FirstBurstLength = 262144
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.MaxBurstLength = 16776192
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.DefaultTime2Retain = 0
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.DefaultTime2Wait = 2
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.MaxConnections = 1
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 09 02:26:54 user nova-compute[75438]: node.session.iscsi.ERL = 0
Nov 09 02:26:54 user nova-compute[75438]: node.session.scan = manual
Nov 09 02:26:54 user nova-compute[75438]: node.session.reopen_max = 0
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].address = 172.16.0.220
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].port = 3260
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].startup = manual
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].tcp.window_size = 524288
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].tcp.type_of_service = 0
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].timeo.logout_timeout = 15
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].timeo.login_timeout = 15
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].timeo.auth_timeout = 45
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].timeo.noop_out_interval = 5
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].timeo.noop_out_timeout = 5
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].iscsi.HeaderDigest = None
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].iscsi.DataDigest = None
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].iscsi.IFMarker = No
Nov 09 02:26:54 user nova-compute[75438]: node.conn[0].iscsi.OFMarker = No
Nov 09 02:26:54 user nova-compute[75438]: # END RECORD
Nov 09 02:26:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd0290-01c5-4d21-aae6-ad53b5ae0921]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ae1c5-dfb0-4dff-9c18-41115c8769ef]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSMyTkYX {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DSMyTkYX" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[de993e53-e0bf-49fd-bceb-77d480e773ca]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DSMyTkYX'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa725a88-812c-489c-a8ae-14f60cf75431]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[664fe78e-6200-4f2e-adad-0f5ce9b02115]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:26:54 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:26:54 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:26:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:26:54 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:26:54 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:26:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] HCTL ('33', '0', '0', 0) found on session 43 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d4ec43-7be1-442a-80a1-7d7b986b4a49]: (4, ('0 0 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Searching for a device in session 43 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '23833323536346632', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833323536346632', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477158708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477158708',id=36,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-b0wq3bk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:25:03Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=28f31033-0b5e-4968-8641-abee31542b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "vif_mac": "fa:16:3e:e5:91:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "vif_mac": "fa:16:3e:e5:91:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'pci_devices' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.objects.base [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Object Instance<28f31033-0b5e-4968-8641-abee31542b90> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:26:54 user nova-compute[75438]:   <uuid>28f31033-0b5e-4968-8641-abee31542b90</uuid>
Nov 09 02:26:54 user nova-compute[75438]:   <name>instance-00000024</name>
Nov 09 02:26:54 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:26:54 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:26:54 user nova-compute[75438]:   <metadata>
Nov 09 02:26:54 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:26:54 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:26:54 user nova-compute[75438]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1477158708</nova:name>
Nov 09 02:26:54 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:26:54</nova:creationTime>
Nov 09 02:26:54 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:26:54 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:26:54 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:26:54 user nova-compute[75438]:       <nova:owner>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:user uuid="3160dcb696a24d3db8bd3a22064cbd7a">tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member</nova:user>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:project uuid="f7d490c388e64d5fbdeec47eb532482e">tempest-ServerBootFromVolumeStableRescueTest-1794136160</nova:project>
Nov 09 02:26:54 user nova-compute[75438]:       </nova:owner>
Nov 09 02:26:54 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:26:54 user nova-compute[75438]:       <nova:ports>
Nov 09 02:26:54 user nova-compute[75438]:         <nova:port uuid="0ca6d939-5f08-4666-8cac-bdb1abc805dc">
Nov 09 02:26:54 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:26:54 user nova-compute[75438]:         </nova:port>
Nov 09 02:26:54 user nova-compute[75438]:       </nova:ports>
Nov 09 02:26:54 user nova-compute[75438]:     </nova:instance>
Nov 09 02:26:54 user nova-compute[75438]:   </metadata>
Nov 09 02:26:54 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:26:54 user nova-compute[75438]:     <system>
Nov 09 02:26:54 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:26:54 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:26:54 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:26:54 user nova-compute[75438]:       <entry name="serial">28f31033-0b5e-4968-8641-abee31542b90</entry>
Nov 09 02:26:54 user nova-compute[75438]:       <entry name="uuid">28f31033-0b5e-4968-8641-abee31542b90</entry>
Nov 09 02:26:54 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:26:54 user nova-compute[75438]:     </system>
Nov 09 02:26:54 user nova-compute[75438]:   </sysinfo>
Nov 09 02:26:54 user nova-compute[75438]:   <os>
Nov 09 02:26:54 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:26:54 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:26:54 user nova-compute[75438]:   </os>
Nov 09 02:26:54 user nova-compute[75438]:   <features>
Nov 09 02:26:54 user nova-compute[75438]:     <acpi/>
Nov 09 02:26:54 user nova-compute[75438]:     <apic/>
Nov 09 02:26:54 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:26:54 user nova-compute[75438]:   </features>
Nov 09 02:26:54 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:26:54 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:26:54 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:26:54 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:26:54 user nova-compute[75438]:   </clock>
Nov 09 02:26:54 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:26:54 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:26:54 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:26:54 user nova-compute[75438]:   </cpu>
Nov 09 02:26:54 user nova-compute[75438]:   <devices>
Nov 09 02:26:54 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:26:54 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:26:54 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:26:54 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:26:54 user nova-compute[75438]:       <serial>8578f031-f819-4f70-964e-97af066593c1</serial>
Nov 09 02:26:54 user nova-compute[75438]:     </disk>
Nov 09 02:26:54 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:26:54 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:26:54 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue"/>
Nov 09 02:26:54 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:26:54 user nova-compute[75438]:       <boot order="1"/>
Nov 09 02:26:54 user nova-compute[75438]:     </disk>
Nov 09 02:26:54 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:26:54 user nova-compute[75438]:       <mac address="fa:16:3e:e5:91:9f"/>
Nov 09 02:26:54 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:26:54 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:26:54 user nova-compute[75438]:       <target dev="tap0ca6d939-5f"/>
Nov 09 02:26:54 user nova-compute[75438]:     </interface>
Nov 09 02:26:54 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:26:54 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/console.log" append="off"/>
Nov 09 02:26:54 user nova-compute[75438]:     </serial>
Nov 09 02:26:54 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:26:54 user nova-compute[75438]:     <video>
Nov 09 02:26:54 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:26:54 user nova-compute[75438]:     </video>
Nov 09 02:26:54 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:26:54 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:26:54 user nova-compute[75438]:     </rng>
Nov 09 02:26:54 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:26:54 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:26:54 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:26:54 user nova-compute[75438]:     </memballoon>
Nov 09 02:26:54 user nova-compute[75438]:   </devices>
Nov 09 02:26:54 user nova-compute[75438]: </domain>
Nov 09 02:26:54 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:26:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance destroyed successfully.
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:26:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] No VIF found with MAC fa:16:3e:e5:91:9f, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:26:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-54236904-7863-4307-a354-e25f1dfd0106 req-c88bdc97-2782-4d92-b791-70b01e746e22 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-54236904-7863-4307-a354-e25f1dfd0106 req-c88bdc97-2782-4d92-b791-70b01e746e22 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-54236904-7863-4307-a354-e25f1dfd0106 req-c88bdc97-2782-4d92-b791-70b01e746e22 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-54236904-7863-4307-a354-e25f1dfd0106 req-c88bdc97-2782-4d92-b791-70b01e746e22 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-54236904-7863-4307-a354-e25f1dfd0106 req-c88bdc97-2782-4d92-b791-70b01e746e22 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:26:56 user nova-compute[75438]: WARNING nova.compute.manager [req-54236904-7863-4307-a354-e25f1dfd0106 req-c88bdc97-2782-4d92-b791-70b01e746e22 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state active and task_state rescuing.
Nov 09 02:26:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:26:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "16336dee-4c57-4e22-9ece-a67e8846b507" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:57 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:26:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:57 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:26:57 user nova-compute[75438]: INFO nova.compute.claims [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Claim successful on node user
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:26:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.policy [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5297e15fd14f1395cb606e791c4202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c21c58de14dbda4534441cad48918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:26:58 user nova-compute[75438]: INFO nova.virt.block_device [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Booting with volume 61f6892c-2b84-4d81-853b-a5fb77691eb0 at /dev/vda
Nov 09 02:26:58 user nova-compute[75438]: DEBUG os_brick.utils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d7363-6957-4476-8cd5-593311db8a86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28a7bf1-f787-4b56-9c86-b4f5258fdd58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf60fd4f-f791-4ce5-919e-3789ae1ff542]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbafc89-5492-485d-b8dc-42d020edc107]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:26:58 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[234ed5d5-7bc8-4c01-8b04-b722bd865bdb]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG os_brick.utils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updating existing volume attachment record: e2003c8b-018e-4de8-8632-be596d4817e6 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-a0c7e737-bc98-466b-b0f3-2d9fef04daf6 req-52b05726-e314-46cd-a0e6-a47485be9db5 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a0c7e737-bc98-466b-b0f3-2d9fef04daf6 req-52b05726-e314-46cd-a0e6-a47485be9db5 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a0c7e737-bc98-466b-b0f3-2d9fef04daf6 req-52b05726-e314-46cd-a0e6-a47485be9db5 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a0c7e737-bc98-466b-b0f3-2d9fef04daf6 req-52b05726-e314-46cd-a0e6-a47485be9db5 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:26:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-a0c7e737-bc98-466b-b0f3-2d9fef04daf6 req-52b05726-e314-46cd-a0e6-a47485be9db5 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:26:58 user nova-compute[75438]: WARNING nova.compute.manager [req-a0c7e737-bc98-466b-b0f3-2d9fef04daf6 req-52b05726-e314-46cd-a0e6-a47485be9db5 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state active and task_state rescuing.
Nov 09 02:26:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Successfully created port: 7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f9779b63-4317-4ed5-93a6-be285fe80e5c tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Successfully updated port: 7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquired lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Going to confirm migration 2 {{(pid=75438) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 09 02:26:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquired lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'info_cache' on Instance uuid 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.network.neutron [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updating instance_info_cache with network_info: [{"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Releasing lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Instance network_info: |[{"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [{"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Releasing lock "refresh_cache-0ab2b7b0-8519-424b-b3b9-39152b4c25c1" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'migration_context' on Instance uuid 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.objects.base [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Object Instance<0ab2b7b0-8519-424b-b3b9-39152b4c25c1> lazy-loaded attributes: info_cache,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-changed-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.compute.manager [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Refreshing instance network info cache due to event network-changed-7d3c4e3d-d7e6-430b-b7ff-6127035d882d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] Acquiring lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] Acquired lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG nova.network.neutron [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Refreshing network info cache for port 7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:27:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:01 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:27:01 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:27:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.568s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:01 user nova-compute[75438]: DEBUG nova.network.neutron [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updated VIF entry in instance network info cache for port 7d3c4e3d-d7e6-430b-b7ff-6127035d882d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:27:01 user nova-compute[75438]: DEBUG nova.network.neutron [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updating instance_info_cache with network_info: [{"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:27:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3599d285-8163-44e0-b61b-ff31081e1cdc req-dd7f256f-0c37-4b82-8b1e-5e63ee1a8d34 service nova] Releasing lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:27:01 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Deleted allocation for migration 237f3141-0849-4b68-9ce4-bafcbf8ced44
Nov 09 02:27:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d822d13c-d2dc-4972-bad3-65cb054bc6f4 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.784s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:27:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:27:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:27:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:27:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:27:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:27:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:27:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:27:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:27:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [{"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-074d5809-da5f-4158-83e1-651c8518efaa" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:27:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:27:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:37 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:27:37 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7971MB free_disk=24.74243927001953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 28f31033-0b5e-4968-8641-abee31542b90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e1a0f4aa-e857-45f4-84e8-0c973556d402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 16336dee-4c57-4e22-9ece-a67e8846b507 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:27:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:27:38 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:27:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:27:38 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:27:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:27:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:27:44 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Creating image(s)
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Ensure instance console log exists: /opt/stack/data/nova/instances/16336dee-4c57-4e22-9ece-a67e8846b507/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Start _get_guest_xml network_info=[{"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e2003c8b-018e-4de8-8632-be596d4817e6', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZrlXST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16336dee-4c57-4e22-9ece-a67e8846b507', 'attached_at': '', 'detached_at': '', 'volume_id': '61f6892c-2b84-4d81-853b-a5fb77691eb0', 'serial': '61f6892c-2b84-4d81-853b-a5fb77691eb0'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:27:44 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:27:44 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZrlXST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:27:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:27:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:27:44 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[152846cb-71b3-43a2-bd9b-07515bdd8e38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:27:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[44040829-ae89-45c6-aa22-9fa233e9efc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0] added
Nov 09 02:27:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977825a-6a37-4988-91e0-4740a27f20ad]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef858b86-196a-45ff-968b-06f01135e190]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DiZrlXST {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DiZrlXST" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4c59c-aac6-4935-8a4c-ab95f687c597]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DiZrlXST'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f00dd0-dfa6-41e7-a893-22a3e247d9de]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cd4233-557c-4a0b-9c86-0e0cb6557279]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dadfe928-e7b4-4c0c-8177-3faf6e29061b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3959d2-09bc-4022-a96d-e47247211bdb (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dadfe928-e7b4-4c0c-8177-3faf6e29061b (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3959d2-09bc-4022-a96d-e47247211bdb (non-flash)
Nov 09 02:27:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dadfe928-e7b4-4c0c-8177-3faf6e29061b (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3959d2-09bc-4022-a96d-e47247211bdb (non-flash)
Nov 09 02:27:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6b043e-f688-4938-a1f3-be5b1586b0c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260]
Nov 09 02:27:44 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260] successful.
Nov 09 02:27:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc89736-3d66-4ba5-b0b5-3068404baf5c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ff413-2056-4c2f-a7be-efc884a3b27d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dadfe928-e7b4-4c0c-8177-3faf6e29061b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3959d2-09bc-4022-a96d-e47247211bdb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dadfe928-e7b4-4c0c-8177-3faf6e29061b (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3959d2-09bc-4022-a96d-e47247211bdb (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dadfe928-e7b4-4c0c-8177-3faf6e29061b (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb3959d2-09bc-4022-a96d-e47247211bdb (non-flash)
Nov 09 02:27:44 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:27:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f0c232-d3e5-42f6-9f7a-7216d962229b]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:27:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZrlXST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23562636536373536', 'path': '/dev/sdg'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562636536373536', 'path': '/dev/sdg'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-799104561',display_name='tempest-TestVolumeBootPattern-volume-backed-server-799104561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-799104561',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2JPTniliEobTua9nd1x1oIkCUySIqAc2OQ+qmZLSN6ismt+9W9bPV1nDTWGMTeqDU7J7j4ruERBI83W7GTPn1MlLao8KcHDqgiHXRjOk9AKUgaKWYACN3X+8UIU912MQ==',key_name='tempest-keypair-1832962067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-ux005pso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5297e15fd14f1395cb606e791c4202',uuid=16336dee-4c57-4e22-9ece-a67e8846b507,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.objects.instance [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'pci_devices' on Instance uuid 16336dee-4c57-4e22-9ece-a67e8846b507 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:27:45 user nova-compute[75438]:   <uuid>16336dee-4c57-4e22-9ece-a67e8846b507</uuid>
Nov 09 02:27:45 user nova-compute[75438]:   <name>instance-00000026</name>
Nov 09 02:27:45 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:27:45 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:27:45 user nova-compute[75438]:   <metadata>
Nov 09 02:27:45 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:27:45 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:27:45 user nova-compute[75438]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-799104561</nova:name>
Nov 09 02:27:45 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:27:44</nova:creationTime>
Nov 09 02:27:45 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:27:45 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:27:45 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:27:45 user nova-compute[75438]:       <nova:owner>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:user uuid="3b5297e15fd14f1395cb606e791c4202">tempest-TestVolumeBootPattern-1394927917-project-member</nova:user>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:project uuid="8f6c21c58de14dbda4534441cad48918">tempest-TestVolumeBootPattern-1394927917</nova:project>
Nov 09 02:27:45 user nova-compute[75438]:       </nova:owner>
Nov 09 02:27:45 user nova-compute[75438]:       <nova:ports>
Nov 09 02:27:45 user nova-compute[75438]:         <nova:port uuid="7d3c4e3d-d7e6-430b-b7ff-6127035d882d">
Nov 09 02:27:45 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 02:27:45 user nova-compute[75438]:         </nova:port>
Nov 09 02:27:45 user nova-compute[75438]:       </nova:ports>
Nov 09 02:27:45 user nova-compute[75438]:     </nova:instance>
Nov 09 02:27:45 user nova-compute[75438]:   </metadata>
Nov 09 02:27:45 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:27:45 user nova-compute[75438]:     <system>
Nov 09 02:27:45 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:27:45 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:27:45 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:27:45 user nova-compute[75438]:       <entry name="serial">16336dee-4c57-4e22-9ece-a67e8846b507</entry>
Nov 09 02:27:45 user nova-compute[75438]:       <entry name="uuid">16336dee-4c57-4e22-9ece-a67e8846b507</entry>
Nov 09 02:27:45 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:27:45 user nova-compute[75438]:     </system>
Nov 09 02:27:45 user nova-compute[75438]:   </sysinfo>
Nov 09 02:27:45 user nova-compute[75438]:   <os>
Nov 09 02:27:45 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:27:45 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:27:45 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:27:45 user nova-compute[75438]:   </os>
Nov 09 02:27:45 user nova-compute[75438]:   <features>
Nov 09 02:27:45 user nova-compute[75438]:     <acpi/>
Nov 09 02:27:45 user nova-compute[75438]:     <apic/>
Nov 09 02:27:45 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:27:45 user nova-compute[75438]:   </features>
Nov 09 02:27:45 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:27:45 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:27:45 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:27:45 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:27:45 user nova-compute[75438]:   </clock>
Nov 09 02:27:45 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:27:45 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:27:45 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:27:45 user nova-compute[75438]:   </cpu>
Nov 09 02:27:45 user nova-compute[75438]:   <devices>
Nov 09 02:27:45 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:27:45 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:27:45 user nova-compute[75438]:       <source dev="/dev/sdg"/>
Nov 09 02:27:45 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:27:45 user nova-compute[75438]:       <serial>61f6892c-2b84-4d81-853b-a5fb77691eb0</serial>
Nov 09 02:27:45 user nova-compute[75438]:     </disk>
Nov 09 02:27:45 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:27:45 user nova-compute[75438]:       <mac address="fa:16:3e:b2:5a:0e"/>
Nov 09 02:27:45 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:27:45 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:27:45 user nova-compute[75438]:       <target dev="tap7d3c4e3d-d7"/>
Nov 09 02:27:45 user nova-compute[75438]:     </interface>
Nov 09 02:27:45 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:27:45 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/16336dee-4c57-4e22-9ece-a67e8846b507/console.log" append="off"/>
Nov 09 02:27:45 user nova-compute[75438]:     </serial>
Nov 09 02:27:45 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:27:45 user nova-compute[75438]:     <video>
Nov 09 02:27:45 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:27:45 user nova-compute[75438]:     </video>
Nov 09 02:27:45 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:27:45 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:27:45 user nova-compute[75438]:     </rng>
Nov 09 02:27:45 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:27:45 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:27:45 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:27:45 user nova-compute[75438]:     </memballoon>
Nov 09 02:27:45 user nova-compute[75438]:   </devices>
Nov 09 02:27:45 user nova-compute[75438]: </domain>
Nov 09 02:27:45 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-799104561',display_name='tempest-TestVolumeBootPattern-volume-backed-server-799104561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-799104561',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2JPTniliEobTua9nd1x1oIkCUySIqAc2OQ+qmZLSN6ismt+9W9bPV1nDTWGMTeqDU7J7j4ruERBI83W7GTPn1MlLao8KcHDqgiHXRjOk9AKUgaKWYACN3X+8UIU912MQ==',key_name='tempest-keypair-1832962067',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-ux005pso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:26:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5297e15fd14f1395cb606e791c4202',uuid=16336dee-4c57-4e22-9ece-a67e8846b507,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG os_vif [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0843425-b54f-5a8b-aace-04963512fa1f', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d3c4e3d-d7, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d3c4e3d-d7, col_values=(('qos', UUID('0cc0e4aa-120a-41f4-be37-851951b85c3c')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d3c4e3d-d7, col_values=(('external_ids', {'iface-id': '7d3c4e3d-d7e6-430b-b7ff-6127035d882d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:5a:0e', 'vm-uuid': '16336dee-4c57-4e22-9ece-a67e8846b507'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:45 user nova-compute[75438]: INFO os_vif [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7')
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:27:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No VIF found with MAC fa:16:3e:b2:5a:0e, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-fca48475-c212-4749-97b5-78159552040c req-bbedb96d-f681-428a-822d-d88ed122158a service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fca48475-c212-4749-97b5-78159552040c req-bbedb96d-f681-428a-822d-d88ed122158a service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fca48475-c212-4749-97b5-78159552040c req-bbedb96d-f681-428a-822d-d88ed122158a service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fca48475-c212-4749-97b5-78159552040c req-bbedb96d-f681-428a-822d-d88ed122158a service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-fca48475-c212-4749-97b5-78159552040c req-bbedb96d-f681-428a-822d-d88ed122158a service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:27:47 user nova-compute[75438]: WARNING nova.compute.manager [req-fca48475-c212-4749-97b5-78159552040c req-bbedb96d-f681-428a-822d-d88ed122158a service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received unexpected event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with vm_state building and task_state spawning.
Nov 09 02:27:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:27:49 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Instance spawned successfully.
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:27:49 user nova-compute[75438]: INFO nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-c355690d-2145-4835-b1b3-5054117cdc0a req-09e37ff1-3765-4706-a622-e2517f0b372b service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c355690d-2145-4835-b1b3-5054117cdc0a req-09e37ff1-3765-4706-a622-e2517f0b372b service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c355690d-2145-4835-b1b3-5054117cdc0a req-09e37ff1-3765-4706-a622-e2517f0b372b service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c355690d-2145-4835-b1b3-5054117cdc0a req-09e37ff1-3765-4706-a622-e2517f0b372b service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:49 user nova-compute[75438]: DEBUG nova.compute.manager [req-c355690d-2145-4835-b1b3-5054117cdc0a req-09e37ff1-3765-4706-a622-e2517f0b372b service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:27:49 user nova-compute[75438]: WARNING nova.compute.manager [req-c355690d-2145-4835-b1b3-5054117cdc0a req-09e37ff1-3765-4706-a622-e2517f0b372b service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received unexpected event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with vm_state building and task_state spawning.
Nov 09 02:27:49 user nova-compute[75438]: INFO nova.compute.manager [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Took 52.40 seconds to build instance.
Nov 09 02:27:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-a887dd0e-23ac-433a-a256-7c11dbd17740 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "16336dee-4c57-4e22-9ece-a67e8846b507" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.687s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:27:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:27:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:28:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:28:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:28:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:28:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-changed-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Refreshing instance network info cache due to event network-changed-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:28:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] Acquiring lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:28:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] Acquired lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:28:03 user nova-compute[75438]: DEBUG nova.network.neutron [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Refreshing network info cache for port 0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:28:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updated VIF entry in instance network info cache for port 0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:28:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updating instance_info_cache with network_info: [{"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:28:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1a5febc8-35be-4ed1-a456-8e62f6e8c3a7 req-35cf42ce-880e-4537-aa76-12838b058859 service nova] Releasing lock "refresh_cache-e1a0f4aa-e857-45f4-84e8-0c973556d402" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:11 user nova-compute[75438]: INFO nova.compute.manager [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Attaching volume 6305e4fc-bda3-4416-8f93-25458d16c7f8 to /dev/vdb
Nov 09 02:28:11 user nova-compute[75438]: DEBUG os_brick.utils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a84d04c-beab-4273-bf63-237b204a3be1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780154a-53a5-41a9-8876-291f503ec950]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec15f6c-742c-4a26-b173-1379a326e210]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[279371de-6c8d-411c-a63e-41d681808c4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:28:11 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:28:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f359105-a56b-4552-ab28-af41f78247b5]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG os_brick.utils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:28:11 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updating existing volume attachment record: eb2633a0-70e7-4e7d-ba0f-417952bcaead {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:28:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:28:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:28:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:28:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:28:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:28:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating instance_info_cache with network_info: [{"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:28:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-77276a3a-25bc-4fc4-978b-8597ce732f2e" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:28:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Lckmijlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:28:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:28:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:28:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:28:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:28:35 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:28:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a16797c-714a-4c9c-ba77-47f3b605c154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:28:35 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[06357324-511b-4695-a8a0-fb16dfceab52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8] added
Nov 09 02:28:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6040e39-a065-4daf-9543-6d30cfe043ae]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1731bc-04f0-4322-9e7b-f101575a6575]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Lckmijlp {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Lckmijlp" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4752cbbf-fad2-4404-90b3-0b7ad1dd75fc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Lckmijlp'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc2b19d-6ef1-4e06-9f45-2cb5b7e37bf2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42c70a5-b978-4837-b511-2e89bc98e55b]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6ec7d-dd09-4151-84b3-01e9299b1a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260]
Nov 09 02:28:36 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260] successful.
Nov 09 02:28:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b983e1de-8fec-4eac-8b83-45f73cc42a32]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e545540-60a7-4b64-af2a-8afed7d7d2dc]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 (non-flash)
Nov 09 02:28:36 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6992cffa-2e02-4ff1-99b0-b0b75bf62f03]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Lckmijlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:36 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23837666330353863', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837666330353863', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:28:37 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:28:37 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:28:37 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:28:37 user nova-compute[75438]:   <serial>6305e4fc-bda3-4416-8f93-25458d16c7f8</serial>
Nov 09 02:28:37 user nova-compute[75438]: </disk>
Nov 09 02:28:37 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:28:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:62:dc:70, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-81ca12d1-f4b4-41ca-abd6-58e38dbb1102 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.648s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:28:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:39 user nova-compute[75438]: INFO nova.compute.manager [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Detaching volume 6305e4fc-bda3-4416-8f93-25458d16c7f8
Nov 09 02:28:39 user nova-compute[75438]: INFO nova.virt.block_device [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Attempting to driver detach volume 6305e4fc-bda3-4416-8f93-25458d16c7f8 from mountpoint /dev/vdb
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Attempting to detach device vdb from instance e1a0f4aa-e857-45f4-84e8-0c973556d402 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:28:39 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:28:39 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:28:39 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:28:39 user nova-compute[75438]:   <serial>6305e4fc-bda3-4416-8f93-25458d16c7f8</serial>
Nov 09 02:28:39 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:28:39 user nova-compute[75438]: </disk>
Nov 09 02:28:39 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:28:39 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully detached device vdb from instance e1a0f4aa-e857-45f4-84e8-0c973556d402 from the persistent domain config.
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1a0f4aa-e857-45f4-84e8-0c973556d402 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:28:39 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:28:39 user nova-compute[75438]:   <source dev="/dev/sdd"/>
Nov 09 02:28:39 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:28:39 user nova-compute[75438]:   <serial>6305e4fc-bda3-4416-8f93-25458d16c7f8</serial>
Nov 09 02:28:39 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:28:39 user nova-compute[75438]: </disk>
Nov 09 02:28:39 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:28:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:40 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:28:40 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=7956MB free_disk=24.730926513671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 77276a3a-25bc-4fc4-978b-8597ce732f2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 28f31033-0b5e-4968-8641-abee31542b90 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e1a0f4aa-e857-45f4-84e8-0c973556d402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 16336dee-4c57-4e22-9ece-a67e8846b507 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.754s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:41 user nova-compute[75438]: INFO nova.compute.manager [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Unrescuing
Nov 09 02:28:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:28:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquired lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:28:41 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:28:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating instance_info_cache with network_info: [{"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Releasing lock "refresh_cache-28f31033-0b5e-4968-8641-abee31542b90" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'flavor' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-5098dce5-f447-4318-ace9-617d3dddfa5b req-72495073-4607-456e-8a97-6d38dbbcdd00 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5098dce5-f447-4318-ace9-617d3dddfa5b req-72495073-4607-456e-8a97-6d38dbbcdd00 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5098dce5-f447-4318-ace9-617d3dddfa5b req-72495073-4607-456e-8a97-6d38dbbcdd00 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5098dce5-f447-4318-ace9-617d3dddfa5b req-72495073-4607-456e-8a97-6d38dbbcdd00 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-5098dce5-f447-4318-ace9-617d3dddfa5b req-72495073-4607-456e-8a97-6d38dbbcdd00 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:42 user nova-compute[75438]: WARNING nova.compute.manager [req-5098dce5-f447-4318-ace9-617d3dddfa5b req-72495073-4607-456e-8a97-6d38dbbcdd00 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance destroyed successfully.
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:44 user nova-compute[75438]: WARNING nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:44 user nova-compute[75438]: WARNING nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:44 user nova-compute[75438]: WARNING nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:44 user nova-compute[75438]: WARNING nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:44 user nova-compute[75438]: WARNING nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:44 user nova-compute[75438]: WARNING nova.compute.manager [req-a042de04-0375-42d1-8e63-9ad9abd23594 req-005c6b3b-96c0-43d7-8a27-40ecd9e33744 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7c8b6618-2c21-4991-b749-d49376fd2254 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:28:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6e23ab2-3dda-4b3b-81e9-9d83357226ac req-2d78a39b-168f-4a02-9235-d655fb8fd801 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:28:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6e23ab2-3dda-4b3b-81e9-9d83357226ac req-2d78a39b-168f-4a02-9235-d655fb8fd801 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:28:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6e23ab2-3dda-4b3b-81e9-9d83357226ac req-2d78a39b-168f-4a02-9235-d655fb8fd801 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:28:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e6e23ab2-3dda-4b3b-81e9-9d83357226ac req-2d78a39b-168f-4a02-9235-d655fb8fd801 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:28:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-e6e23ab2-3dda-4b3b-81e9-9d83357226ac req-2d78a39b-168f-4a02-9235-d655fb8fd801 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:28:47 user nova-compute[75438]: WARNING nova.compute.manager [req-e6e23ab2-3dda-4b3b-81e9-9d83357226ac req-2d78a39b-168f-4a02-9235-d655fb8fd801 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state rescued and task_state unrescuing.
Nov 09 02:28:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:28:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:28:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:28:51 user nova-compute[75438]: INFO nova.compute.manager [None req-bfd5dfd8-46f9-4961-8268-8fc64559632d tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Get console output
Nov 09 02:28:51 user nova-compute[75438]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 09 02:28:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:28:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:28:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:28:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:28:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:28:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:28:59 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1a0f4aa-e857-45f4-84e8-0c973556d402 is timed out.
Nov 09 02:28:59 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully detached device vdb from instance e1a0f4aa-e857-45f4-84e8-0c973556d402 from the live domain config.
Nov 09 02:28:59 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Lckmijlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:28:59 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff91def-f04c-4e2d-8707-3513b6dfe46e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:28:59 user nova-compute[75438]: No targets found.
Nov 09 02:28:59 user nova-compute[75438]: iSNS:
Nov 09 02:28:59 user nova-compute[75438]: No targets found.
Nov 09 02:28:59 user nova-compute[75438]: STATIC:
Nov 09 02:28:59 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:28:59 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:28:59 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:28:59 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8
Nov 09 02:28:59 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:28:59 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:28:59 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f
Nov 09 02:28:59 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:28:59 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:28:59 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1
Nov 09 02:28:59 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:28:59 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:28:59 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0
Nov 09 02:28:59 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:28:59 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:28:59 user nova-compute[75438]: FIRMWARE:
Nov 09 02:28:59 user nova-compute[75438]: No targets found.
Nov 09 02:28:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:28:59 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:28:59 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb01be8-fab5-4e63-8bfa-0ef3fa38d6d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[85357f82-1025-491f-b226-8e969e2542b9]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 (non-flash)
Nov 09 02:28:59 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24581870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2379ae36-8a0c-4528-9f76-e8d9db0bc951]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b1bbf-afbf-4181-8962-334539b2f2af]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[06012dee-422f-4150-bc5a-1d44525a13e8]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88fcdf4-bb50-4b95-96b5-0d40d0963e71]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.076s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b73b1-e92c-4b87-b0d6-73d31fc8c95c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:28:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b3f61d-7bb8-4c8f-8c1c-a03e8e6daa37]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260]
Nov 09 02:29:00 user nova-compute[75438]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8, portal: 172.16.0.220,3260] successful.
Nov 09 02:29:00 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6305e4fc-bda3-4416-8f93-25458d16c7f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b6f17-75ec-44f6-ab55-7e2c437e9ff6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== disconnect_volume: return (418ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:29:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:08 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:29:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c0f0f9b0-0b81-4c89-9f23-f465d9902057 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.434s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:20 user nova-compute[75438]: INFO nova.compute.manager [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Terminating instance
Nov 09 02:29:20 user nova-compute[75438]: DEBUG nova.compute.manager [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-e764309d-3c98-47f1-ac37-ab19225770fc req-78f18094-b9d5-401e-806f-80b83162effc service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-vif-unplugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e764309d-3c98-47f1-ac37-ab19225770fc req-78f18094-b9d5-401e-806f-80b83162effc service nova] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e764309d-3c98-47f1-ac37-ab19225770fc req-78f18094-b9d5-401e-806f-80b83162effc service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e764309d-3c98-47f1-ac37-ab19225770fc req-78f18094-b9d5-401e-806f-80b83162effc service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-e764309d-3c98-47f1-ac37-ab19225770fc req-78f18094-b9d5-401e-806f-80b83162effc service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] No waiting events found dispatching network-vif-unplugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-e764309d-3c98-47f1-ac37-ab19225770fc req-78f18094-b9d5-401e-806f-80b83162effc service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-vif-unplugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:29:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Instance destroyed successfully.
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.objects.instance [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lazy-loading 'resources' on Instance uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-964764817',display_name='tempest-SnapshotDataIntegrityTests-server-964764817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-964764817',id=27,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQz3I9PCJZnlZhBeBglpNn95TVl6X2Tf2QmhxfnwWZCjNdYgNa0ty89v4Z9QJhwr88zhqIZhBP+JVf+RUq8ildIwsMtxhW+lRmudKigclTLRkbQOHOU08ZE/vyfe0ch1w==',key_name='tempest-keypair-1705516396',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e35bd9611ea14910ab54504a8a6f0f7a',ramdisk_id='',reservation_id='r-whg6gcsh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-788108331',owner_user_name='tempest-SnapshotDataIntegrityTests-788108331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb053462f626448db04acd63d8489bdd',uuid=77276a3a-25bc-4fc4-978b-8597ce732f2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Converting VIF {"id": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "address": "fa:16:3e:03:d7:69", "network": {"id": "513149f9-b74c-4284-9db4-362087ed5c48", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-408767523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e35bd9611ea14910ab54504a8a6f0f7a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cbd945f-fb", "ovs_interfaceid": "9cbd945f-fb48-48b9-ba20-178b54a7f26b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG os_vif [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cbd945f-fb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6d1214d-8dc3-4672-9516-46fa71ee59f4) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:29:21 user nova-compute[75438]: INFO os_vif [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d7:69,bridge_name='br-int',has_traffic_filtering=True,id=9cbd945f-fb48-48b9-ba20-178b54a7f26b,network=Network(513149f9-b74c-4284-9db4-362087ed5c48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cbd945f-fb')
Nov 09 02:29:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Deleting instance files /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e_del
Nov 09 02:29:21 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Deletion of /opt/stack/data/nova/instances/77276a3a-25bc-4fc4-978b-8597ce732f2e_del complete
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid e2cc1833-7812-4534-aa5a-b793f37b5254 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 77276a3a-25bc-4fc4-978b-8597ce732f2e {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid d287e82e-ad77-45c0-93a2-d0907410ddca {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 16336dee-4c57-4e22-9ece-a67e8846b507 {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "074d5809-da5f-4158-83e1-651c8518efaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "28f31033-0b5e-4968-8641-abee31542b90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "16336dee-4c57-4e22-9ece-a67e8846b507" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "074d5809-da5f-4158-83e1-651c8518efaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "28f31033-0b5e-4968-8641-abee31542b90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:21 user nova-compute[75438]: INFO nova.compute.manager [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:29:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "16336dee-4c57-4e22-9ece-a67e8846b507" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:22 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Took 0.70 seconds to deallocate network for instance.
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:22 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Deleted allocations for instance 77276a3a-25bc-4fc4-978b-8597ce732f2e
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-da2681ad-a38e-4bf0-9d49-ccf8cdae5d35 tempest-SnapshotDataIntegrityTests-788108331 tempest-SnapshotDataIntegrityTests-788108331-project-member] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.310s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:22 user nova-compute[75438]: INFO nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] Acquiring lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] Lock "77276a3a-25bc-4fc4-978b-8597ce732f2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] No waiting events found dispatching network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:29:22 user nova-compute[75438]: WARNING nova.compute.manager [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received unexpected event network-vif-plugged-9cbd945f-fb48-48b9-ba20-178b54a7f26b for instance with vm_state deleted and task_state None.
Nov 09 02:29:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-0f3a3208-ac24-4382-be91-ea85bd63a17f req-df186b0e-3871-4056-9d8e-83caa7497b61 service nova] [instance: 77276a3a-25bc-4fc4-978b-8597ce732f2e] Received event network-vif-deleted-9cbd945f-fb48-48b9-ba20-178b54a7f26b {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:29 user nova-compute[75438]: INFO nova.compute.manager [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Terminating instance
Nov 09 02:29:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-82bd71af-4606-4f8c-acf5-00db8964ecc9 req-5a302ea2-393f-4315-97dc-1fdea5094ae5 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-vif-unplugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82bd71af-4606-4f8c-acf5-00db8964ecc9 req-5a302ea2-393f-4315-97dc-1fdea5094ae5 service nova] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82bd71af-4606-4f8c-acf5-00db8964ecc9 req-5a302ea2-393f-4315-97dc-1fdea5094ae5 service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82bd71af-4606-4f8c-acf5-00db8964ecc9 req-5a302ea2-393f-4315-97dc-1fdea5094ae5 service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-82bd71af-4606-4f8c-acf5-00db8964ecc9 req-5a302ea2-393f-4315-97dc-1fdea5094ae5 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] No waiting events found dispatching network-vif-unplugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:29:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-82bd71af-4606-4f8c-acf5-00db8964ecc9 req-5a302ea2-393f-4315-97dc-1fdea5094ae5 service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-vif-unplugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:29:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Instance destroyed successfully.
Nov 09 02:29:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'resources' on Instance uuid e1a0f4aa-e857-45f4-84e8-0c973556d402 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-111841088',display_name='tempest-AttachVolumeNegativeTest-server-111841088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-111841088',id=37,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8lCZUJa2muuKIDPKWXyl40H7ylfdJ+Eambb3ztDQNmONDYf9MApmvu5dZpkw4TZD9QmEa1DWp3+9haOt9+iMW4Fht2flO2bY+WnKHVxlXNikJbNlL3cpqXMdReI3KGaw==',key_name='tempest-keypair-1005296627',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-n0xhnmp1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=e1a0f4aa-e857-45f4-84e8-0c973556d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "address": "fa:16:3e:62:dc:70", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dea5bf1-3d", "ovs_interfaceid": "0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG os_vif [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dea5bf1-3d, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34149ae4-84f2-4a8a-90b0-5250448a781b) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:29:30 user nova-compute[75438]: INFO os_vif [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:dc:70,bridge_name='br-int',has_traffic_filtering=True,id=0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dea5bf1-3d')
Nov 09 02:29:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Deleting instance files /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402_del
Nov 09 02:29:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Deletion of /opt/stack/data/nova/instances/e1a0f4aa-e857-45f4-84e8-0c973556d402_del complete
Nov 09 02:29:30 user nova-compute[75438]: INFO nova.compute.manager [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 09 02:29:30 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:29:30 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:31 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Took 0.73 seconds to deallocate network for instance.
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:31 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Deleted allocations for instance e1a0f4aa-e857-45f4-84e8-0c973556d402
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fef600d5-cef4-47b0-a26b-3656ea2b6ffe tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] Acquiring lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] Lock "e1a0f4aa-e857-45f4-84e8-0c973556d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] No waiting events found dispatching network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:29:31 user nova-compute[75438]: WARNING nova.compute.manager [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received unexpected event network-vif-plugged-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f for instance with vm_state deleted and task_state None.
Nov 09 02:29:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-55502cdb-6802-4d5c-8158-3d4b8ce1281b req-5892de06-33f9-496a-842f-d9eb8fea218e service nova] [instance: e1a0f4aa-e857-45f4-84e8-0c973556d402] Received event network-vif-deleted-0dea5bf1-3da3-49e1-a5e2-0e45dd2c920f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:29:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:29:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:29:33 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:29:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updating instance_info_cache with network_info: [{"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-d287e82e-ad77-45c0-93a2-d0907410ddca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:29:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:29:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:29:37 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-changed-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Refreshing instance network info cache due to event network-changed-7d3c4e3d-d7e6-430b-b7ff-6127035d882d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] Acquiring lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] Acquired lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Refreshing network info cache for port 7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updated VIF entry in instance network info cache for port 7d3c4e3d-d7e6-430b-b7ff-6127035d882d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updating instance_info_cache with network_info: [{"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9d2bdaa3-87d9-4aaa-84c5-a647bb907a2b req-720f98dd-088d-4347-8b6d-80bdfdb7afb9 service nova] Releasing lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:29:39 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:29:39 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8258MB free_disk=24.785869598388672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 28f31033-0b5e-4968-8641-abee31542b90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 16336dee-4c57-4e22-9ece-a67e8846b507 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:29:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:29:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:29:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:51 user nova-compute[75438]: INFO nova.compute.manager [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Terminating instance
Nov 09 02:29:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-6e06664c-9799-47e2-aec6-93b039d21f54 req-50a5e153-a6fa-48de-a33c-a596c2cbbdae service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-unplugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6e06664c-9799-47e2-aec6-93b039d21f54 req-50a5e153-a6fa-48de-a33c-a596c2cbbdae service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6e06664c-9799-47e2-aec6-93b039d21f54 req-50a5e153-a6fa-48de-a33c-a596c2cbbdae service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6e06664c-9799-47e2-aec6-93b039d21f54 req-50a5e153-a6fa-48de-a33c-a596c2cbbdae service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-6e06664c-9799-47e2-aec6-93b039d21f54 req-50a5e153-a6fa-48de-a33c-a596c2cbbdae service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-unplugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-6e06664c-9799-47e2-aec6-93b039d21f54 req-50a5e153-a6fa-48de-a33c-a596c2cbbdae service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-unplugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:29:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Instance destroyed successfully.
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'resources' on Instance uuid 0ab2b7b0-8519-424b-b3b9-39152b4c25c1 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:21:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-674388167',display_name='tempest-ServerActionsTestOtherA-server-674388167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-674388167',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-53ezskuj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=0ab2b7b0-8519-424b-b3b9-39152b4c25c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "44e587c3-eb25-4da8-b054-5439a13ebf51", "address": "fa:16:3e:36:6c:75", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44e587c3-eb", "ovs_interfaceid": "44e587c3-eb25-4da8-b054-5439a13ebf51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_vif [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44e587c3-eb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=244045fa-2439-4e67-913c-3748989fa10b) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:52 user nova-compute[75438]: INFO os_vif [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:6c:75,bridge_name='br-int',has_traffic_filtering=True,id=44e587c3-eb25-4da8-b054-5439a13ebf51,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44e587c3-eb')
Nov 09 02:29:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtYWyQTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:29:52 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8e3e9f-22a2-4827-ae9c-a8e065b189be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:29:52 user nova-compute[75438]: No targets found.
Nov 09 02:29:52 user nova-compute[75438]: iSNS:
Nov 09 02:29:52 user nova-compute[75438]: No targets found.
Nov 09 02:29:52 user nova-compute[75438]: STATIC:
Nov 09 02:29:52 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:29:52 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:29:52 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:29:52 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f
Nov 09 02:29:52 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:29:52 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:29:52 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1
Nov 09 02:29:52 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:29:52 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:29:52 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0
Nov 09 02:29:52 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:29:52 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:29:52 user nova-compute[75438]: FIRMWARE:
Nov 09 02:29:52 user nova-compute[75438]: No targets found.
Nov 09 02:29:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:29:52 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:29:52 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[498f9af8-ddf5-4dbb-bdb0-17bf87d7af6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c7d099-1303-47de-9538-7f8db4eefee8]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:29:52 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:29:52 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:29:52 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:29:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:29:52 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:29:52 user nova-compute[75438]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f (non-flash)
Nov 09 02:29:52 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:29:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0442e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f335ad42-04a8-459a-8531-0b256fc08c74]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d155788-fc38-49b8-a3fa-07ae66cd5547]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0908a739-40e4-4655-9d04-73b5e354ddbf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[943985cb-71d6-4ce2-8f21-a8bdb9ef72ff]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d2de5e-eaa8-4da1-804e-df1148ff189b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:29:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[918b3fbb-1ed0-4a2d-bb40-6282d85cb562]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260]
Nov 09 02:29:53 user nova-compute[75438]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f, portal: 172.16.0.220,3260] successful.
Nov 09 02:29:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c58efce2-07e1-4947-b9fe-94da4ddc6a2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9292c8-dde2-4482-89e7-bf0baa9c3e44]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] <== disconnect_volume: return (366ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:29:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Deleting instance files /opt/stack/data/nova/instances/0ab2b7b0-8519-424b-b3b9-39152b4c25c1_del
Nov 09 02:29:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Deletion of /opt/stack/data/nova/instances/0ab2b7b0-8519-424b-b3b9-39152b4c25c1_del complete
Nov 09 02:29:53 user nova-compute[75438]: INFO nova.compute.manager [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 09 02:29:53 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:29:53 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:53 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Took 0.86 seconds to deallocate network for instance.
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-39fe4aa0-a00c-419e-9a9b-114432a292bd req-d323a994-ad1d-481f-993d-bd37dd96b91c service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-deleted-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:29:54 user nova-compute[75438]: INFO nova.compute.claims [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Claim successful on node user
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-51212796-7530-4cb7-bc48-38ffdf0ba9bb req-85a0a988-1c19-4d92-91e2-5fb26164468c service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-51212796-7530-4cb7-bc48-38ffdf0ba9bb req-85a0a988-1c19-4d92-91e2-5fb26164468c service nova] Acquiring lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-51212796-7530-4cb7-bc48-38ffdf0ba9bb req-85a0a988-1c19-4d92-91e2-5fb26164468c service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-51212796-7530-4cb7-bc48-38ffdf0ba9bb req-85a0a988-1c19-4d92-91e2-5fb26164468c service nova] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-51212796-7530-4cb7-bc48-38ffdf0ba9bb req-85a0a988-1c19-4d92-91e2-5fb26164468c service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] No waiting events found dispatching network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:29:54 user nova-compute[75438]: WARNING nova.compute.manager [req-51212796-7530-4cb7-bc48-38ffdf0ba9bb req-85a0a988-1c19-4d92-91e2-5fb26164468c service nova] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Received unexpected event network-vif-plugged-44e587c3-eb25-4da8-b054-5439a13ebf51 for instance with vm_state active and task_state deleting.
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:29:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:29:54 user nova-compute[75438]: INFO nova.virt.block_device [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Booting with volume snapshot 8e97c25d-4ac6-40cd-883f-fdfa13515a84 at /dev/vda
Nov 09 02:29:54 user nova-compute[75438]: DEBUG nova.policy [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5297e15fd14f1395cb606e791c4202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c21c58de14dbda4534441cad48918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:29:55 user nova-compute[75438]: INFO nova.compute.manager [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Took 1.08 seconds to detach 1 volumes for instance.
Nov 09 02:29:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: 0ab2b7b0-8519-424b-b3b9-39152b4c25c1] Deleting volume: c58efce2-07e1-4947-b9fe-94da4ddc6a2f {{(pid=75438) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 02:29:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:29:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:29:55 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:29:55 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:29:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Successfully created port: 8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:29:55 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Deleted allocations for instance 0ab2b7b0-8519-424b-b3b9-39152b4c25c1
Nov 09 02:29:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4d389a0e-f48c-4ed4-8c0e-2f465eb00536 tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "0ab2b7b0-8519-424b-b3b9-39152b4c25c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.939s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Successfully updated port: 8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquired lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-changed-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Refreshing instance network info cache due to event network-changed-8a24c2f6-a681-447d-963a-1b940cea62a4. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] Acquiring lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updating instance_info_cache with network_info: [{"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Releasing lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Instance network_info: |[{"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] Acquired lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:29:56 user nova-compute[75438]: DEBUG nova.network.neutron [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Refreshing network info cache for port 8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:29:57 user nova-compute[75438]: DEBUG nova.network.neutron [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updated VIF entry in instance network info cache for port 8a24c2f6-a681-447d-963a-1b940cea62a4. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:29:57 user nova-compute[75438]: DEBUG nova.network.neutron [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updating instance_info_cache with network_info: [{"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:29:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-95f31d83-5f53-4f2b-b9d8-f11e971c46e3 req-9badb56f-b364-4b35-ac6d-2317cf0300a9 service nova] Releasing lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:29:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG os_brick.utils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[211f1ed3-ea87-49fe-9a94-1eb91fff6c76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1671a8-f8df-4e28-a01e-e99a02f190e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d6953-8b21-4aae-a4db-6a54d3035810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5579c4-ceb1-416a-a2a9-cae30ad20610]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:30:05 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:30:05 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51606c7-386a-4529-ab41-65888d2dcaa1]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG os_brick.utils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:30:05 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updating existing volume attachment record: dcc0a25b-ce30-4d04-a452-34fa59c2ee7e {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:30:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:30:23 user nova-compute[75438]: INFO nova.compute.claims [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Claim successful on node user
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:30:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.policy [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f241dbd509b4beb8148222f8379d58e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '374722030e844844b670f169c722977c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:30:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Creating image(s)
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "/opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "/opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.186s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk 1073741824" returned: 0 in 0.075s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Successfully created port: 8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Cannot resize image /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Ensure instance console log exists: /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Successfully updated port: 8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquired lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-changed-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Refreshing instance network info cache due to event network-changed-8c28c2d5-a1d0-4e23-8203-f01931608a8f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] Acquiring lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updating instance_info_cache with network_info: [{"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Releasing lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Instance network_info: |[{"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] Acquired lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Refreshing network info cache for port 8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Start _get_guest_xml network_info=[{"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:30:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:30:25 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2070077868',display_name='tempest-AttachVolumeNegativeTest-server-2070077868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2070077868',id=40,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6l7SChDM4Bo1YeIU7T6WGaYLrEWXvXD9i3O8or3sY9bUCrVXQOjK3/hgbM6QfMM5+UewKmGSylMQKnfJ/yEwJAIfb00R2J4k5dVoji0U+1YR6gPgRMqZGQHLw+4r4Pkg==',key_name='tempest-keypair-2041839532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-epdz4kv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:30:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=92b346f1-c9a2-4ac6-817f-e47c02259715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'pci_devices' on Instance uuid 92b346f1-c9a2-4ac6-817f-e47c02259715 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:30:25 user nova-compute[75438]:   <uuid>92b346f1-c9a2-4ac6-817f-e47c02259715</uuid>
Nov 09 02:30:25 user nova-compute[75438]:   <name>instance-00000028</name>
Nov 09 02:30:25 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:30:25 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:30:25 user nova-compute[75438]:   <metadata>
Nov 09 02:30:25 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:30:25 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:30:25 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2070077868</nova:name>
Nov 09 02:30:25 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:30:25</nova:creationTime>
Nov 09 02:30:25 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:30:25 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:30:25 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:30:25 user nova-compute[75438]:       <nova:owner>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:user uuid="1f241dbd509b4beb8148222f8379d58e">tempest-AttachVolumeNegativeTest-1037659816-project-member</nova:user>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:project uuid="374722030e844844b670f169c722977c">tempest-AttachVolumeNegativeTest-1037659816</nova:project>
Nov 09 02:30:25 user nova-compute[75438]:       </nova:owner>
Nov 09 02:30:25 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:30:25 user nova-compute[75438]:       <nova:ports>
Nov 09 02:30:25 user nova-compute[75438]:         <nova:port uuid="8c28c2d5-a1d0-4e23-8203-f01931608a8f">
Nov 09 02:30:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:30:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:30:25 user nova-compute[75438]:       </nova:ports>
Nov 09 02:30:25 user nova-compute[75438]:     </nova:instance>
Nov 09 02:30:25 user nova-compute[75438]:   </metadata>
Nov 09 02:30:25 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:30:25 user nova-compute[75438]:     <system>
Nov 09 02:30:25 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:30:25 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:30:25 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:30:25 user nova-compute[75438]:       <entry name="serial">92b346f1-c9a2-4ac6-817f-e47c02259715</entry>
Nov 09 02:30:25 user nova-compute[75438]:       <entry name="uuid">92b346f1-c9a2-4ac6-817f-e47c02259715</entry>
Nov 09 02:30:25 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:30:25 user nova-compute[75438]:     </system>
Nov 09 02:30:25 user nova-compute[75438]:   </sysinfo>
Nov 09 02:30:25 user nova-compute[75438]:   <os>
Nov 09 02:30:25 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:30:25 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:30:25 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:30:25 user nova-compute[75438]:   </os>
Nov 09 02:30:25 user nova-compute[75438]:   <features>
Nov 09 02:30:25 user nova-compute[75438]:     <acpi/>
Nov 09 02:30:25 user nova-compute[75438]:     <apic/>
Nov 09 02:30:25 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:30:25 user nova-compute[75438]:   </features>
Nov 09 02:30:25 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:30:25 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:30:25 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:30:25 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:30:25 user nova-compute[75438]:   </clock>
Nov 09 02:30:25 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:30:25 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:30:25 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:30:25 user nova-compute[75438]:   </cpu>
Nov 09 02:30:25 user nova-compute[75438]:   <devices>
Nov 09 02:30:25 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:30:25 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:30:25 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk"/>
Nov 09 02:30:25 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:30:25 user nova-compute[75438]:     </disk>
Nov 09 02:30:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:30:25 user nova-compute[75438]:       <mac address="fa:16:3e:f1:d8:4d"/>
Nov 09 02:30:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:30:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:30:25 user nova-compute[75438]:       <target dev="tap8c28c2d5-a1"/>
Nov 09 02:30:25 user nova-compute[75438]:     </interface>
Nov 09 02:30:25 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:30:25 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/console.log" append="off"/>
Nov 09 02:30:25 user nova-compute[75438]:     </serial>
Nov 09 02:30:25 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:30:25 user nova-compute[75438]:     <video>
Nov 09 02:30:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:30:25 user nova-compute[75438]:     </video>
Nov 09 02:30:25 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:30:25 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:30:25 user nova-compute[75438]:     </rng>
Nov 09 02:30:25 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:30:25 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:30:25 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:30:25 user nova-compute[75438]:     </memballoon>
Nov 09 02:30:25 user nova-compute[75438]:   </devices>
Nov 09 02:30:25 user nova-compute[75438]: </domain>
Nov 09 02:30:25 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2070077868',display_name='tempest-AttachVolumeNegativeTest-server-2070077868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2070077868',id=40,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6l7SChDM4Bo1YeIU7T6WGaYLrEWXvXD9i3O8or3sY9bUCrVXQOjK3/hgbM6QfMM5+UewKmGSylMQKnfJ/yEwJAIfb00R2J4k5dVoji0U+1YR6gPgRMqZGQHLw+4r4Pkg==',key_name='tempest-keypair-2041839532',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-epdz4kv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:30:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=92b346f1-c9a2-4ac6-817f-e47c02259715,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG os_vif [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc6364a2-e1aa-510a-bb91-89fec197dcf5', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c28c2d5-a1, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c28c2d5-a1, col_values=(('qos', UUID('ffd2bbfa-48b8-4f1f-b5f6-10784b296768')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c28c2d5-a1, col_values=(('external_ids', {'iface-id': '8c28c2d5-a1d0-4e23-8203-f01931608a8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:d8:4d', 'vm-uuid': '92b346f1-c9a2-4ac6-817f-e47c02259715'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:25 user nova-compute[75438]: INFO os_vif [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1')
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:f1:d8:4d, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updated VIF entry in instance network info cache for port 8c28c2d5-a1d0-4e23-8203-f01931608a8f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updating instance_info_cache with network_info: [{"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:30:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e74c56ec-213c-4bc0-947f-c34d2e5a1261 req-c6e04a05-5523-4080-b542-313228b5464a service nova] Releasing lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:30:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-9e450d08-f042-4a64-b0e0-73cfa9c10b67 req-7c6201c2-2a5c-49cb-9c59-79cf7e3483a8 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9e450d08-f042-4a64-b0e0-73cfa9c10b67 req-7c6201c2-2a5c-49cb-9c59-79cf7e3483a8 service nova] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9e450d08-f042-4a64-b0e0-73cfa9c10b67 req-7c6201c2-2a5c-49cb-9c59-79cf7e3483a8 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9e450d08-f042-4a64-b0e0-73cfa9c10b67 req-7c6201c2-2a5c-49cb-9c59-79cf7e3483a8 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-9e450d08-f042-4a64-b0e0-73cfa9c10b67 req-7c6201c2-2a5c-49cb-9c59-79cf7e3483a8 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] No waiting events found dispatching network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:27 user nova-compute[75438]: WARNING nova.compute.manager [req-9e450d08-f042-4a64-b0e0-73cfa9c10b67 req-7c6201c2-2a5c-49cb-9c59-79cf7e3483a8 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received unexpected event network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f for instance with vm_state building and task_state spawning.
Nov 09 02:30:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-09b46f89-6ede-4eef-a703-5c48d479eb90 req-89ff699a-b211-4f37-8d44-424ca25a4c88 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-09b46f89-6ede-4eef-a703-5c48d479eb90 req-89ff699a-b211-4f37-8d44-424ca25a4c88 service nova] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-09b46f89-6ede-4eef-a703-5c48d479eb90 req-89ff699a-b211-4f37-8d44-424ca25a4c88 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-09b46f89-6ede-4eef-a703-5c48d479eb90 req-89ff699a-b211-4f37-8d44-424ca25a4c88 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-09b46f89-6ede-4eef-a703-5c48d479eb90 req-89ff699a-b211-4f37-8d44-424ca25a4c88 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] No waiting events found dispatching network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:29 user nova-compute[75438]: WARNING nova.compute.manager [req-09b46f89-6ede-4eef-a703-5c48d479eb90 req-89ff699a-b211-4f37-8d44-424ca25a4c88 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received unexpected event network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f for instance with vm_state building and task_state spawning.
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:30:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Instance spawned successfully.
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:29 user nova-compute[75438]: INFO nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:30:29 user nova-compute[75438]: INFO nova.compute.manager [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Took 6.24 seconds to build instance.
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-0ffa3e94-6461-497a-91da-bef278e47984 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.337s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:30:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Creating image(s)
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Ensure instance console log exists: /opt/stack/data/nova/instances/70f9b4d8-eb61-4104-8d0d-7f93815b8101/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Start _get_guest_xml network_info=[{"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-09T02:29:40Z,direct_url=<?>,disk_format='qcow2',id=2f66b15b-f583-4f18-a18f-62acf10d7933,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-601259046',owner='8f6c21c58de14dbda4534441cad48918',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-09T02:29:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'dcc0a25b-ce30-4d04-a452-34fa59c2ee7e', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFpEIfva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '70f9b4d8-eb61-4104-8d0d-7f93815b8101', 'attached_at': '', 'detached_at': '', 'volume_id': '65054d1d-e547-42ca-b240-67c3331327e2', 'serial': '65054d1d-e547-42ca-b240-67c3331327e2'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:30:29 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:30:29 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-09T02:29:40Z,direct_url=<?>,disk_format='qcow2',id=2f66b15b-f583-4f18-a18f-62acf10d7933,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-601259046',owner='8f6c21c58de14dbda4534441cad48918',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-09T02:29:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFpEIfva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:30:29 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:30:29 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:30:29 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ada69f6-8c5c-46f3-b7b5-4c7ac09957bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:30:29 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e56fa32-5c6a-4a2f-93ac-a6635dd51d95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2] added
Nov 09 02:30:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1d342c-222d-40be-816f-f24efd8f13f5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce15aef-1d7d-498a-bd40-e2adb17a0a40]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFpEIfva {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UFpEIfva" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[118abd56-ff78-448a-8123-4d85c8db823f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UFpEIfva'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9bec84-df5d-4882-936d-a53509b73ab2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f0a1de-85b0-41a2-a69d-cae915f4288a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:30:29 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:30:29 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:30:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:30:29 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:30:29 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:30:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c1dcf0-c533-445e-a746-7d475e6a7b02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260]
Nov 09 02:30:29 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260] successful.
Nov 09 02:30:29 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2388b-3bb6-4728-a9ae-360132a20599]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db20f61-c11f-4c5d-95ed-7d287d4c8630]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)
Nov 09 02:30:30 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08a7a7-ceae-493a-a24d-a87b9743e2e6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFpEIfva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:30:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26139643962616335', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139643962616335', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1390572532',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1390572532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1390572532',id=39,image_ref='2f66b15b-f583-4f18-a18f-62acf10d7933',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGBQvcGs7FcLV5oNZJs/au0uRZNJcS2sDLuxa/sMCu0IaphmEdR2cLlPN4w37N1qcPlMSjMNThnQVpl82UAn0j+BS3NvDIFMJO0K2NBPNN0uknAXxa95CZJX2DfVROCaA==',key_name='tempest-keypair-2142832305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-m1gieo8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1394927917',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5297e15fd14f1395cb606e791c4202',uuid=70f9b4d8-eb61-4104-8d0d-7f93815b8101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.objects.instance [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'pci_devices' on Instance uuid 70f9b4d8-eb61-4104-8d0d-7f93815b8101 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:30:31 user nova-compute[75438]:   <uuid>70f9b4d8-eb61-4104-8d0d-7f93815b8101</uuid>
Nov 09 02:30:31 user nova-compute[75438]:   <name>instance-00000027</name>
Nov 09 02:30:31 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:30:31 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:30:31 user nova-compute[75438]:   <metadata>
Nov 09 02:30:31 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:30:31 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:30:31 user nova-compute[75438]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1390572532</nova:name>
Nov 09 02:30:31 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:30:29</nova:creationTime>
Nov 09 02:30:31 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:30:31 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:30:31 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:30:31 user nova-compute[75438]:       <nova:owner>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:user uuid="3b5297e15fd14f1395cb606e791c4202">tempest-TestVolumeBootPattern-1394927917-project-member</nova:user>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:project uuid="8f6c21c58de14dbda4534441cad48918">tempest-TestVolumeBootPattern-1394927917</nova:project>
Nov 09 02:30:31 user nova-compute[75438]:       </nova:owner>
Nov 09 02:30:31 user nova-compute[75438]:       <nova:root type="image" uuid="2f66b15b-f583-4f18-a18f-62acf10d7933"/>
Nov 09 02:30:31 user nova-compute[75438]:       <nova:ports>
Nov 09 02:30:31 user nova-compute[75438]:         <nova:port uuid="8a24c2f6-a681-447d-963a-1b940cea62a4">
Nov 09 02:30:31 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 09 02:30:31 user nova-compute[75438]:         </nova:port>
Nov 09 02:30:31 user nova-compute[75438]:       </nova:ports>
Nov 09 02:30:31 user nova-compute[75438]:     </nova:instance>
Nov 09 02:30:31 user nova-compute[75438]:   </metadata>
Nov 09 02:30:31 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:30:31 user nova-compute[75438]:     <system>
Nov 09 02:30:31 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:30:31 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:30:31 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:30:31 user nova-compute[75438]:       <entry name="serial">70f9b4d8-eb61-4104-8d0d-7f93815b8101</entry>
Nov 09 02:30:31 user nova-compute[75438]:       <entry name="uuid">70f9b4d8-eb61-4104-8d0d-7f93815b8101</entry>
Nov 09 02:30:31 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:30:31 user nova-compute[75438]:     </system>
Nov 09 02:30:31 user nova-compute[75438]:   </sysinfo>
Nov 09 02:30:31 user nova-compute[75438]:   <os>
Nov 09 02:30:31 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:30:31 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:30:31 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:30:31 user nova-compute[75438]:   </os>
Nov 09 02:30:31 user nova-compute[75438]:   <features>
Nov 09 02:30:31 user nova-compute[75438]:     <acpi/>
Nov 09 02:30:31 user nova-compute[75438]:     <apic/>
Nov 09 02:30:31 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:30:31 user nova-compute[75438]:   </features>
Nov 09 02:30:31 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:30:31 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:30:31 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:30:31 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:30:31 user nova-compute[75438]:   </clock>
Nov 09 02:30:31 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:30:31 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:30:31 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:30:31 user nova-compute[75438]:   </cpu>
Nov 09 02:30:31 user nova-compute[75438]:   <devices>
Nov 09 02:30:31 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:30:31 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:30:31 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:30:31 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:30:31 user nova-compute[75438]:       <serial>65054d1d-e547-42ca-b240-67c3331327e2</serial>
Nov 09 02:30:31 user nova-compute[75438]:     </disk>
Nov 09 02:30:31 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:30:31 user nova-compute[75438]:       <mac address="fa:16:3e:ca:17:c3"/>
Nov 09 02:30:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:30:31 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:30:31 user nova-compute[75438]:       <target dev="tap8a24c2f6-a6"/>
Nov 09 02:30:31 user nova-compute[75438]:     </interface>
Nov 09 02:30:31 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:30:31 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/70f9b4d8-eb61-4104-8d0d-7f93815b8101/console.log" append="off"/>
Nov 09 02:30:31 user nova-compute[75438]:     </serial>
Nov 09 02:30:31 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:30:31 user nova-compute[75438]:     <video>
Nov 09 02:30:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:30:31 user nova-compute[75438]:     </video>
Nov 09 02:30:31 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:30:31 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:30:31 user nova-compute[75438]:     </rng>
Nov 09 02:30:31 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:30:31 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:30:31 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:30:31 user nova-compute[75438]:     </memballoon>
Nov 09 02:30:31 user nova-compute[75438]:   </devices>
Nov 09 02:30:31 user nova-compute[75438]: </domain>
Nov 09 02:30:31 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1390572532',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1390572532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1390572532',id=39,image_ref='2f66b15b-f583-4f18-a18f-62acf10d7933',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGBQvcGs7FcLV5oNZJs/au0uRZNJcS2sDLuxa/sMCu0IaphmEdR2cLlPN4w37N1qcPlMSjMNThnQVpl82UAn0j+BS3NvDIFMJO0K2NBPNN0uknAXxa95CZJX2DfVROCaA==',key_name='tempest-keypair-2142832305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-m1gieo8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1394927917',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5297e15fd14f1395cb606e791c4202',uuid=70f9b4d8-eb61-4104-8d0d-7f93815b8101,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG os_vif [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6269ee53-3d8e-5ce4-93a1-10dc07964fbb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a24c2f6-a6, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a24c2f6-a6, col_values=(('qos', UUID('2d1b1dfc-7afa-4f1c-9b8c-1630c7028387')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a24c2f6-a6, col_values=(('external_ids', {'iface-id': '8a24c2f6-a681-447d-963a-1b940cea62a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:17:c3', 'vm-uuid': '70f9b4d8-eb61-4104-8d0d-7f93815b8101'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:31 user nova-compute[75438]: INFO os_vif [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6')
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:30:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No VIF found with MAC fa:16:3e:ca:17:c3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b05c9e1-0220-40b5-9331-a064ce5bbf28 req-84088ee5-3a2c-4c88-bb98-4c66ca533dc0 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b05c9e1-0220-40b5-9331-a064ce5bbf28 req-84088ee5-3a2c-4c88-bb98-4c66ca533dc0 service nova] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b05c9e1-0220-40b5-9331-a064ce5bbf28 req-84088ee5-3a2c-4c88-bb98-4c66ca533dc0 service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0b05c9e1-0220-40b5-9331-a064ce5bbf28 req-84088ee5-3a2c-4c88-bb98-4c66ca533dc0 service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-0b05c9e1-0220-40b5-9331-a064ce5bbf28 req-84088ee5-3a2c-4c88-bb98-4c66ca533dc0 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] No waiting events found dispatching network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:32 user nova-compute[75438]: WARNING nova.compute.manager [req-0b05c9e1-0220-40b5-9331-a064ce5bbf28 req-84088ee5-3a2c-4c88-bb98-4c66ca533dc0 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received unexpected event network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 for instance with vm_state building and task_state spawning.
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "28f31033-0b5e-4968-8641-abee31542b90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:32 user nova-compute[75438]: INFO nova.compute.manager [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Terminating instance
Nov 09 02:30:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:30:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Instance destroyed successfully.
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.objects.instance [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'resources' on Instance uuid 28f31033-0b5e-4968-8641-abee31542b90 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1477158708',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1477158708',id=36,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:26:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-b0wq3bk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:28:47Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=28f31033-0b5e-4968-8641-abee31542b90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "address": "fa:16:3e:e5:91:9f", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca6d939-5f", "ovs_interfaceid": "0ca6d939-5f08-4666-8cac-bdb1abc805dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_vif [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca6d939-5f, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69a5a2b7-2e15-4f8a-9a2d-1f20f0a72d33) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:33 user nova-compute[75438]: INFO os_vif [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:91:9f,bridge_name='br-int',has_traffic_filtering=True,id=0ca6d939-5f08-4666-8cac-bdb1abc805dc,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca6d939-5f')
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DSMyTkYX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:30:33 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f1fa5-ec20-4edd-9d52-1a48464d98ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:30:33 user nova-compute[75438]: No targets found.
Nov 09 02:30:33 user nova-compute[75438]: iSNS:
Nov 09 02:30:33 user nova-compute[75438]: No targets found.
Nov 09 02:30:33 user nova-compute[75438]: STATIC:
Nov 09 02:30:33 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:30:33 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:30:33 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:30:33 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2
Nov 09 02:30:33 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:30:33 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:30:33 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1
Nov 09 02:30:33 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:30:33 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:30:33 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0
Nov 09 02:30:33 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:30:33 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:30:33 user nova-compute[75438]: FIRMWARE:
Nov 09 02:30:33 user nova-compute[75438]: No targets found.
Nov 09 02:30:33 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:30:33 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:30:33 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c38212-9a0c-4e90-bf17-488714646e61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630dca1-4e4c-4a09-b197-333836d26d56]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)
Nov 09 02:30:33 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba04298ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a8b92e-78ff-4c98-b243-0c7eded80200]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f3d8f0-f213-49fd-bcba-ecfe62bfc07c]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Skipping network cache update for instance because it is being deleted. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2534da58-8a3d-4a54-8023-b9f2e5fccb9c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0bb166-c844-41b4-97a8-b7b19e9b7078]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:30:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6db4c2-caa2-42ce-a128-cbe5b412a968]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d7110d-306b-43ee-9593-8cbfa2947a98]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260]
Nov 09 02:30:34 user nova-compute[75438]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1, portal: 172.16.0.220,3260] successful.
Nov 09 02:30:34 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8578f031-f819-4f70-964e-97af066593c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e47a1-9eea-4e0c-8a12-3c18e1e9c41f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== disconnect_volume: return (357ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Deleting instance files /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90_del
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Deletion of /opt/stack/data/nova/instances/28f31033-0b5e-4968-8641-abee31542b90_del complete
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.compute.manager [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Took 0.42 seconds to deallocate network for instance.
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-15aa9db9-3d71-4a45-a4bd-49299070b25b req-43c56201-bb2f-4e5b-8867-6140b7de1e7d service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-deleted-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.compute.manager [req-15aa9db9-3d71-4a45-a4bd-49299070b25b req-43c56201-bb2f-4e5b-8867-6140b7de1e7d service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Neutron deleted interface 0ca6d939-5f08-4666-8cac-bdb1abc805dc; detaching it from the instance and deleting it from the info cache
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.network.neutron [req-15aa9db9-3d71-4a45-a4bd-49299070b25b req-43c56201-bb2f-4e5b-8867-6140b7de1e7d service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-15aa9db9-3d71-4a45-a4bd-49299070b25b req-43c56201-bb2f-4e5b-8867-6140b7de1e7d service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Detach interface failed, port_id=0ca6d939-5f08-4666-8cac-bdb1abc805dc, reason: Instance 28f31033-0b5e-4968-8641-abee31542b90 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] No waiting events found dispatching network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:34 user nova-compute[75438]: WARNING nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received unexpected event network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 for instance with vm_state building and task_state spawning.
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-unplugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Acquiring lock "28f31033-0b5e-4968-8641-abee31542b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] Lock "28f31033-0b5e-4968-8641-abee31542b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] No waiting events found dispatching network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:34 user nova-compute[75438]: WARNING nova.compute.manager [req-9cd8b7fa-063b-4b96-850e-2cdfb6eb9cf0 req-4b73e2d9-b56b-4c97-a5a1-d7770c7b9306 service nova] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Received unexpected event network-vif-plugged-0ca6d939-5f08-4666-8cac-bdb1abc805dc for instance with vm_state active and task_state deleting.
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Instance spawned successfully.
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:30:34 user nova-compute[75438]: INFO nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 09 02:30:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:30:35 user nova-compute[75438]: INFO nova.compute.manager [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Took 40.90 seconds to build instance.
Nov 09 02:30:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2e0e6eb5-e742-43cd-8961-b4025b5a137f tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.999s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:35 user nova-compute[75438]: INFO nova.compute.manager [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 28f31033-0b5e-4968-8641-abee31542b90] Took 1.08 seconds to detach 1 volumes for instance.
Nov 09 02:30:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:35 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:30:35 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:30:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:36 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Deleted allocations for instance 28f31033-0b5e-4968-8641-abee31542b90
Nov 09 02:30:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-2d5ec4fe-5953-429c-a3e1-e563adbec664 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "28f31033-0b5e-4968-8641-abee31542b90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.226s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:30:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:30:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:30:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:30:41 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:30:41 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:30:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8360MB free_disk=24.778953552246094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e2cc1833-7812-4534-aa5a-b793f37b5254 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d287e82e-ad77-45c0-93a2-d0907410ddca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 16336dee-4c57-4e22-9ece-a67e8846b507 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 70f9b4d8-eb61-4104-8d0d-7f93815b8101 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 92b346f1-c9a2-4ac6-817f-e47c02259715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:30:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:30:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:54 user nova-compute[75438]: INFO nova.compute.manager [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Terminating instance
Nov 09 02:30:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-23c95afb-2037-4e42-9d79-18d8d643c51b req-7e03bf8e-fc0c-441c-afc2-7ad12bb22298 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-vif-unplugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-23c95afb-2037-4e42-9d79-18d8d643c51b req-7e03bf8e-fc0c-441c-afc2-7ad12bb22298 service nova] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-23c95afb-2037-4e42-9d79-18d8d643c51b req-7e03bf8e-fc0c-441c-afc2-7ad12bb22298 service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-23c95afb-2037-4e42-9d79-18d8d643c51b req-7e03bf8e-fc0c-441c-afc2-7ad12bb22298 service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-23c95afb-2037-4e42-9d79-18d8d643c51b req-7e03bf8e-fc0c-441c-afc2-7ad12bb22298 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] No waiting events found dispatching network-vif-unplugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-23c95afb-2037-4e42-9d79-18d8d643c51b req-7e03bf8e-fc0c-441c-afc2-7ad12bb22298 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-vif-unplugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:30:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Instance destroyed successfully.
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lazy-loading 'resources' on Instance uuid e2cc1833-7812-4534-aa5a-b793f37b5254 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:08:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-419065901',display_name='tempest-ServerActionsTestOtherA-server-419065901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-419065901',id=13,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBExdpDwVD3BDxwY7YqqAGf8I2FerInUlVndvxxprWudcwrMVZGRvP0LmB+bAlOq+Adwq96Z7DFMl/C6Lsepmp6K39pt3U2qLW4EwbAdvRAV6Z2vhgF0o9zb7k+S3vQ9UNA==',key_name='tempest-keypair-286286012',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:09:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7a4b29710bb14b8fb9714109aec43dc6',ramdisk_id='',reservation_id='r-ykon7erz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1813489270',owner_user_name='tempest-ServerActionsTestOtherA-1813489270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e95d2465b0af4dcab397b5ccc2809c59',uuid=e2cc1833-7812-4534-aa5a-b793f37b5254,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converting VIF {"id": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "address": "fa:16:3e:9e:2c:e3", "network": {"id": "b84ed048-c015-432a-86d1-d3300994e6fb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-886521914-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7a4b29710bb14b8fb9714109aec43dc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcca4d3f1-d3", "ovs_interfaceid": "cca4d3f1-d39a-4163-aa83-b0df831b92cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG os_vif [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcca4d3f1-d3, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b9a13e9-43a6-43c9-8cf2-a41ecc328625) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:55 user nova-compute[75438]: INFO os_vif [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:2c:e3,bridge_name='br-int',has_traffic_filtering=True,id=cca4d3f1-d39a-4163-aa83-b0df831b92cb,network=Network(b84ed048-c015-432a-86d1-d3300994e6fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcca4d3f1-d3')
Nov 09 02:30:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Deleting instance files /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254_del
Nov 09 02:30:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Deletion of /opt/stack/data/nova/instances/e2cc1833-7812-4534-aa5a-b793f37b5254_del complete
Nov 09 02:30:55 user nova-compute[75438]: INFO nova.compute.manager [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 09 02:30:55 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:30:55 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Took 0.48 seconds to deallocate network for instance.
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-c935e1d1-e473-43d6-b3b4-f51946912264 req-c5536964-1b15-40c7-af8e-dfcb3c2ece18 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-vif-deleted-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:55 user nova-compute[75438]: INFO nova.compute.manager [req-c935e1d1-e473-43d6-b3b4-f51946912264 req-c5536964-1b15-40c7-af8e-dfcb3c2ece18 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Neutron deleted interface cca4d3f1-d39a-4163-aa83-b0df831b92cb; detaching it from the instance and deleting it from the info cache
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.network.neutron [req-c935e1d1-e473-43d6-b3b4-f51946912264 req-c5536964-1b15-40c7-af8e-dfcb3c2ece18 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-c935e1d1-e473-43d6-b3b4-f51946912264 req-c5536964-1b15-40c7-af8e-dfcb3c2ece18 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Detach interface failed, port_id=cca4d3f1-d39a-4163-aa83-b0df831b92cb, reason: Instance e2cc1833-7812-4534-aa5a-b793f37b5254 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:56 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Deleted allocations for instance e2cc1833-7812-4534-aa5a-b793f37b5254
Nov 09 02:30:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bbcce08e-aa5b-4466-a47e-9227f8ab6f0e tempest-ServerActionsTestOtherA-1813489270 tempest-ServerActionsTestOtherA-1813489270-project-member] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.998s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-a956ad7a-a738-4fd9-98b1-ddfc001914ec req-f17908b9-99c3-4cd2-be7f-d0efaac18472 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received event network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a956ad7a-a738-4fd9-98b1-ddfc001914ec req-f17908b9-99c3-4cd2-be7f-d0efaac18472 service nova] Acquiring lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a956ad7a-a738-4fd9-98b1-ddfc001914ec req-f17908b9-99c3-4cd2-be7f-d0efaac18472 service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a956ad7a-a738-4fd9-98b1-ddfc001914ec req-f17908b9-99c3-4cd2-be7f-d0efaac18472 service nova] Lock "e2cc1833-7812-4534-aa5a-b793f37b5254-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:30:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-a956ad7a-a738-4fd9-98b1-ddfc001914ec req-f17908b9-99c3-4cd2-be7f-d0efaac18472 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] No waiting events found dispatching network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:30:56 user nova-compute[75438]: WARNING nova.compute.manager [req-a956ad7a-a738-4fd9-98b1-ddfc001914ec req-f17908b9-99c3-4cd2-be7f-d0efaac18472 service nova] [instance: e2cc1833-7812-4534-aa5a-b793f37b5254] Received unexpected event network-vif-plugged-cca4d3f1-d39a-4163-aa83-b0df831b92cb for instance with vm_state deleted and task_state None.
Nov 09 02:31:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:31:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:31:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:31:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:31:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:31:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:23 user nova-compute[75438]: INFO nova.compute.manager [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Terminating instance
Nov 09 02:31:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-f343fbfc-5a01-4e94-9529-0829aca10faf req-9920cfff-c5bf-4e00-87a4-e67d31ae0e02 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-vif-unplugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f343fbfc-5a01-4e94-9529-0829aca10faf req-9920cfff-c5bf-4e00-87a4-e67d31ae0e02 service nova] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f343fbfc-5a01-4e94-9529-0829aca10faf req-9920cfff-c5bf-4e00-87a4-e67d31ae0e02 service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-f343fbfc-5a01-4e94-9529-0829aca10faf req-9920cfff-c5bf-4e00-87a4-e67d31ae0e02 service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-f343fbfc-5a01-4e94-9529-0829aca10faf req-9920cfff-c5bf-4e00-87a4-e67d31ae0e02 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] No waiting events found dispatching network-vif-unplugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:31:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-f343fbfc-5a01-4e94-9529-0829aca10faf req-9920cfff-c5bf-4e00-87a4-e67d31ae0e02 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-vif-unplugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Instance destroyed successfully.
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.objects.instance [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'resources' on Instance uuid d287e82e-ad77-45c0-93a2-d0907410ddca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:20:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1142971782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1142971782',id=30,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:20:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-o2czctme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:22:17Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=d287e82e-ad77-45c0-93a2-d0907410ddca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "address": "fa:16:3e:cd:bb:87", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5b9ebef-90", "ovs_interfaceid": "e5b9ebef-9096-4d5b-ae91-c0dcbd095b16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG os_vif [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5b9ebef-90, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e297bcb4-978d-40e7-9655-4b8065101d0c) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: INFO os_vif [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:bb:87,bridge_name='br-int',has_traffic_filtering=True,id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5b9ebef-90')
Nov 09 02:31:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Deleting instance files /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca_del
Nov 09 02:31:24 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Deletion of /opt/stack/data/nova/instances/d287e82e-ad77-45c0-93a2-d0907410ddca_del complete
Nov 09 02:31:24 user nova-compute[75438]: INFO nova.compute.manager [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 09 02:31:24 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:31:24 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Took 0.42 seconds to deallocate network for instance.
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-ef48e612-bb59-4548-baf6-7bd934ee9d90 req-d92b4d10-82bd-4174-9a76-f079ae9734b3 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-vif-deleted-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:24 user nova-compute[75438]: INFO nova.compute.manager [req-ef48e612-bb59-4548-baf6-7bd934ee9d90 req-d92b4d10-82bd-4174-9a76-f079ae9734b3 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Neutron deleted interface e5b9ebef-9096-4d5b-ae91-c0dcbd095b16; detaching it from the instance and deleting it from the info cache
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.network.neutron [req-ef48e612-bb59-4548-baf6-7bd934ee9d90 req-d92b4d10-82bd-4174-9a76-f079ae9734b3 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.compute.manager [req-ef48e612-bb59-4548-baf6-7bd934ee9d90 req-d92b4d10-82bd-4174-9a76-f079ae9734b3 service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Detach interface failed, port_id=e5b9ebef-9096-4d5b-ae91-c0dcbd095b16, reason: Instance d287e82e-ad77-45c0-93a2-d0907410ddca could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:24 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:31:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:31:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:25 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Deleted allocations for instance d287e82e-ad77-45c0-93a2-d0907410ddca
Nov 09 02:31:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-40402642-9116-4078-8c50-4f92926a0dd3 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.500s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-c5015df1-d534-495a-96bf-946680111060 req-3106e237-6f03-425b-93f5-bde5f61e697e service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received event network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c5015df1-d534-495a-96bf-946680111060 req-3106e237-6f03-425b-93f5-bde5f61e697e service nova] Acquiring lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c5015df1-d534-495a-96bf-946680111060 req-3106e237-6f03-425b-93f5-bde5f61e697e service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c5015df1-d534-495a-96bf-946680111060 req-3106e237-6f03-425b-93f5-bde5f61e697e service nova] Lock "d287e82e-ad77-45c0-93a2-d0907410ddca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-c5015df1-d534-495a-96bf-946680111060 req-3106e237-6f03-425b-93f5-bde5f61e697e service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] No waiting events found dispatching network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:31:26 user nova-compute[75438]: WARNING nova.compute.manager [req-c5015df1-d534-495a-96bf-946680111060 req-3106e237-6f03-425b-93f5-bde5f61e697e service nova] [instance: d287e82e-ad77-45c0-93a2-d0907410ddca] Received unexpected event network-vif-plugged-e5b9ebef-9096-4d5b-ae91-c0dcbd095b16 for instance with vm_state deleted and task_state None.
Nov 09 02:31:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:31:35 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:31:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [{"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:31:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-7d8acf4e-7bc3-4302-8966-326bcc45ebf7" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:31:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:31:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:31:41 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:31:41 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=24.903194427490234GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 074d5809-da5f-4158-83e1-651c8518efaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 16336dee-4c57-4e22-9ece-a67e8846b507 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 70f9b4d8-eb61-4104-8d0d-7f93815b8101 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 92b346f1-c9a2-4ac6-817f-e47c02259715 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:31:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-changed-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG nova.compute.manager [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Refreshing instance network info cache due to event network-changed-8a24c2f6-a681-447d-963a-1b940cea62a4. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] Acquiring lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] Acquired lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:31:44 user nova-compute[75438]: DEBUG nova.network.neutron [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Refreshing network info cache for port 8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:45 user nova-compute[75438]: INFO nova.compute.manager [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Terminating instance
Nov 09 02:31:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG nova.network.neutron [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updated VIF entry in instance network info cache for port 8a24c2f6-a681-447d-963a-1b940cea62a4. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG nova.network.neutron [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updating instance_info_cache with network_info: [{"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fca2637b-67a7-411d-ae0f-1b071752542d req-b77ebc32-2c0d-4189-a0dc-66d740c1d116 service nova] Releasing lock "refresh_cache-70f9b4d8-eb61-4104-8d0d-7f93815b8101" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-ab4c8c3b-d92e-4c61-bc43-46ab7ca473f4 req-853c64db-4828-489e-b788-744378e6f1db service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-vif-unplugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ab4c8c3b-d92e-4c61-bc43-46ab7ca473f4 req-853c64db-4828-489e-b788-744378e6f1db service nova] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ab4c8c3b-d92e-4c61-bc43-46ab7ca473f4 req-853c64db-4828-489e-b788-744378e6f1db service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ab4c8c3b-d92e-4c61-bc43-46ab7ca473f4 req-853c64db-4828-489e-b788-744378e6f1db service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-ab4c8c3b-d92e-4c61-bc43-46ab7ca473f4 req-853c64db-4828-489e-b788-744378e6f1db service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] No waiting events found dispatching network-vif-unplugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-ab4c8c3b-d92e-4c61-bc43-46ab7ca473f4 req-853c64db-4828-489e-b788-744378e6f1db service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-vif-unplugged-8a24c2f6-a681-447d-963a-1b940cea62a4 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:46 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Instance destroyed successfully.
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'resources' on Instance uuid 70f9b4d8-eb61-4104-8d0d-7f93815b8101 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:29:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1390572532',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1390572532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1390572532',id=39,image_ref='2f66b15b-f583-4f18-a18f-62acf10d7933',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGBQvcGs7FcLV5oNZJs/au0uRZNJcS2sDLuxa/sMCu0IaphmEdR2cLlPN4w37N1qcPlMSjMNThnQVpl82UAn0j+BS3NvDIFMJO0K2NBPNN0uknAXxa95CZJX2DfVROCaA==',key_name='tempest-keypair-2142832305',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:30:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-m1gieo8x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1394927917',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:30:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5297e15fd14f1395cb606e791c4202',uuid=70f9b4d8-eb61-4104-8d0d-7f93815b8101,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "8a24c2f6-a681-447d-963a-1b940cea62a4", "address": "fa:16:3e:ca:17:c3", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a24c2f6-a6", "ovs_interfaceid": "8a24c2f6-a681-447d-963a-1b940cea62a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_vif [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a24c2f6-a6, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d1b1dfc-7afa-4f1c-9b8c-1630c7028387) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:31:46 user nova-compute[75438]: INFO os_vif [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:17:c3,bridge_name='br-int',has_traffic_filtering=True,id=8a24c2f6-a681-447d-963a-1b940cea62a4,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a24c2f6-a6')
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UFpEIfva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:31:46 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec5b4d5-72a3-475c-9f0c-e71877f7df40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:31:46 user nova-compute[75438]: No targets found.
Nov 09 02:31:46 user nova-compute[75438]: iSNS:
Nov 09 02:31:46 user nova-compute[75438]: No targets found.
Nov 09 02:31:46 user nova-compute[75438]: STATIC:
Nov 09 02:31:46 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:31:46 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:31:46 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:31:46 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2
Nov 09 02:31:46 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:31:46 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:31:46 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0
Nov 09 02:31:46 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:31:46 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:31:46 user nova-compute[75438]: FIRMWARE:
Nov 09 02:31:46 user nova-compute[75438]: No targets found.
Nov 09 02:31:46 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:31:46 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:31:46 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6ae1b-69e6-468d-8df3-859407bf5c56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c450b8-31fe-4b8b-9fb2-7bebb7c9c01f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:31:46 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:31:46 user nova-compute[75438]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)
Nov 09 02:31:46 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:31:46 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:31:46 user nova-compute[75438]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 (non-flash)
Nov 09 02:31:46 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24580430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a1c9d6-5a58-48fc-b50e-396eb05917be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d60af46-e308-421d-ba76-6bdef2c3ec24]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a41257d-f408-4408-9a4a-f91e63276356]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.074s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[15739bb1-707f-4b34-840f-88c956919e3b]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5000c77e-901b-4d00-9eec-a5671db8b591]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[49540917-d3d4-44c2-a7c1-81d0d7a8bffe]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260]
Nov 09 02:31:46 user nova-compute[75438]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2, portal: 172.16.0.220,3260] successful.
Nov 09 02:31:46 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65054d1d-e547-42ca-b240-67c3331327e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e20ffc1-3f06-4806-878c-31d0b379cb8b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== disconnect_volume: return (348ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:31:46 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Deleting instance files /opt/stack/data/nova/instances/70f9b4d8-eb61-4104-8d0d-7f93815b8101_del
Nov 09 02:31:46 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Deletion of /opt/stack/data/nova/instances/70f9b4d8-eb61-4104-8d0d-7f93815b8101_del complete
Nov 09 02:31:46 user nova-compute[75438]: INFO nova.compute.manager [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:31:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:47 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:31:47 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Took 0.81 seconds to deallocate network for instance.
Nov 09 02:31:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-ebb94525-b0c6-4ab6-8cd3-af0cf6f624b8 req-738a8d92-b666-42ea-ad0d-36cadc5438f9 service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-vif-deleted-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-68b296c2-930d-44a5-8573-dbb052097ee8 req-ef772972-5232-4b80-a546-1528fa0d30fd service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received event network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:31:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68b296c2-930d-44a5-8573-dbb052097ee8 req-ef772972-5232-4b80-a546-1528fa0d30fd service nova] Acquiring lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68b296c2-930d-44a5-8573-dbb052097ee8 req-ef772972-5232-4b80-a546-1528fa0d30fd service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-68b296c2-930d-44a5-8573-dbb052097ee8 req-ef772972-5232-4b80-a546-1528fa0d30fd service nova] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:47 user nova-compute[75438]: DEBUG nova.compute.manager [req-68b296c2-930d-44a5-8573-dbb052097ee8 req-ef772972-5232-4b80-a546-1528fa0d30fd service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] No waiting events found dispatching network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:31:47 user nova-compute[75438]: WARNING nova.compute.manager [req-68b296c2-930d-44a5-8573-dbb052097ee8 req-ef772972-5232-4b80-a546-1528fa0d30fd service nova] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Received unexpected event network-vif-plugged-8a24c2f6-a681-447d-963a-1b940cea62a4 for instance with vm_state active and task_state deleting.
Nov 09 02:31:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:48 user nova-compute[75438]: INFO nova.compute.manager [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Took 1.00 seconds to detach 1 volumes for instance.
Nov 09 02:31:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 70f9b4d8-eb61-4104-8d0d-7f93815b8101] Deleting volume: 65054d1d-e547-42ca-b240-67c3331327e2 {{(pid=75438) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 02:31:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:31:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:31:48 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:31:48 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:31:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:48 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Deleted allocations for instance 70f9b4d8-eb61-4104-8d0d-7f93815b8101
Nov 09 02:31:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d6609cae-8d67-4d45-be1e-fb0812412d19 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "70f9b4d8-eb61-4104-8d0d-7f93815b8101" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.507s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:31:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:31:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:31:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:32:02 user nova-compute[75438]: INFO nova.compute.claims [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Claim successful on node user
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:32:02 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:32:02 user nova-compute[75438]: DEBUG nova.policy [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07c96c13758649518ea50354b3fe3eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03978fbf1934a1ebdefb24a585d59d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:32:03 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Creating image(s)
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "/opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "/opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk 1073741824" returned: 0 in 0.053s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Successfully created port: 94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Cannot resize image /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Ensure instance console log exists: /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Successfully updated port: 94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "refresh_cache-0c43e735-ec5b-4292-805c-2f172b72b16b" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquired lock "refresh_cache-0c43e735-ec5b-4292-805c-2f172b72b16b" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-changed-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.compute.manager [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Refreshing instance network info cache due to event network-changed-94c36018-1bad-44d2-b2e1-cd28794ffa68. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] Acquiring lock "refresh_cache-0c43e735-ec5b-4292-805c-2f172b72b16b" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Updating instance_info_cache with network_info: [{"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Releasing lock "refresh_cache-0c43e735-ec5b-4292-805c-2f172b72b16b" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Instance network_info: |[{"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] Acquired lock "refresh_cache-0c43e735-ec5b-4292-805c-2f172b72b16b" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Refreshing network info cache for port 94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Start _get_guest_xml network_info=[{"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:32:04 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:32:04 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1178181200',display_name='tempest-VolumesActionsTest-instance-1178181200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1178181200',id=41,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c03978fbf1934a1ebdefb24a585d59d6',ramdisk_id='',reservation_id='r-hvat40ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-146170135',owner_user_name='tempest-VolumesActionsTest-146170135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:32:03Z,user_data=None,user_id='07c96c13758649518ea50354b3fe3eab',uuid=0c43e735-ec5b-4292-805c-2f172b72b16b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converting VIF {"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.objects.instance [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c43e735-ec5b-4292-805c-2f172b72b16b {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:32:04 user nova-compute[75438]:   <uuid>0c43e735-ec5b-4292-805c-2f172b72b16b</uuid>
Nov 09 02:32:04 user nova-compute[75438]:   <name>instance-00000029</name>
Nov 09 02:32:04 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:32:04 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:32:04 user nova-compute[75438]:   <metadata>
Nov 09 02:32:04 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:32:04 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:32:04 user nova-compute[75438]:       <nova:name>tempest-VolumesActionsTest-instance-1178181200</nova:name>
Nov 09 02:32:04 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:32:04</nova:creationTime>
Nov 09 02:32:04 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:32:04 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:32:04 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:32:04 user nova-compute[75438]:       <nova:owner>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:user uuid="07c96c13758649518ea50354b3fe3eab">tempest-VolumesActionsTest-146170135-project-member</nova:user>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:project uuid="c03978fbf1934a1ebdefb24a585d59d6">tempest-VolumesActionsTest-146170135</nova:project>
Nov 09 02:32:04 user nova-compute[75438]:       </nova:owner>
Nov 09 02:32:04 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:32:04 user nova-compute[75438]:       <nova:ports>
Nov 09 02:32:04 user nova-compute[75438]:         <nova:port uuid="94c36018-1bad-44d2-b2e1-cd28794ffa68">
Nov 09 02:32:04 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 09 02:32:04 user nova-compute[75438]:         </nova:port>
Nov 09 02:32:04 user nova-compute[75438]:       </nova:ports>
Nov 09 02:32:04 user nova-compute[75438]:     </nova:instance>
Nov 09 02:32:04 user nova-compute[75438]:   </metadata>
Nov 09 02:32:04 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:32:04 user nova-compute[75438]:     <system>
Nov 09 02:32:04 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:32:04 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:32:04 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:32:04 user nova-compute[75438]:       <entry name="serial">0c43e735-ec5b-4292-805c-2f172b72b16b</entry>
Nov 09 02:32:04 user nova-compute[75438]:       <entry name="uuid">0c43e735-ec5b-4292-805c-2f172b72b16b</entry>
Nov 09 02:32:04 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:32:04 user nova-compute[75438]:     </system>
Nov 09 02:32:04 user nova-compute[75438]:   </sysinfo>
Nov 09 02:32:04 user nova-compute[75438]:   <os>
Nov 09 02:32:04 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:32:04 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:32:04 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:32:04 user nova-compute[75438]:   </os>
Nov 09 02:32:04 user nova-compute[75438]:   <features>
Nov 09 02:32:04 user nova-compute[75438]:     <acpi/>
Nov 09 02:32:04 user nova-compute[75438]:     <apic/>
Nov 09 02:32:04 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:32:04 user nova-compute[75438]:   </features>
Nov 09 02:32:04 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:32:04 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:32:04 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:32:04 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:32:04 user nova-compute[75438]:   </clock>
Nov 09 02:32:04 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:32:04 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:32:04 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:32:04 user nova-compute[75438]:   </cpu>
Nov 09 02:32:04 user nova-compute[75438]:   <devices>
Nov 09 02:32:04 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:32:04 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:32:04 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk"/>
Nov 09 02:32:04 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:32:04 user nova-compute[75438]:     </disk>
Nov 09 02:32:04 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:32:04 user nova-compute[75438]:       <mac address="fa:16:3e:68:41:73"/>
Nov 09 02:32:04 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:32:04 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:32:04 user nova-compute[75438]:       <target dev="tap94c36018-1b"/>
Nov 09 02:32:04 user nova-compute[75438]:     </interface>
Nov 09 02:32:04 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:32:04 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/console.log" append="off"/>
Nov 09 02:32:04 user nova-compute[75438]:     </serial>
Nov 09 02:32:04 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:32:04 user nova-compute[75438]:     <video>
Nov 09 02:32:04 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:32:04 user nova-compute[75438]:     </video>
Nov 09 02:32:04 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:32:04 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:32:04 user nova-compute[75438]:     </rng>
Nov 09 02:32:04 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:32:04 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:32:04 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:32:04 user nova-compute[75438]:     </memballoon>
Nov 09 02:32:04 user nova-compute[75438]:   </devices>
Nov 09 02:32:04 user nova-compute[75438]: </domain>
Nov 09 02:32:04 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1178181200',display_name='tempest-VolumesActionsTest-instance-1178181200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1178181200',id=41,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c03978fbf1934a1ebdefb24a585d59d6',ramdisk_id='',reservation_id='r-hvat40ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-146170135',owner_user_name='tempest-VolumesActionsTest-146170135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:32:03Z,user_data=None,user_id='07c96c13758649518ea50354b3fe3eab',uuid=0c43e735-ec5b-4292-805c-2f172b72b16b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converting VIF {"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG os_vif [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d3385df-d666-59d7-8654-c16bfa492eda', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94c36018-1b, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94c36018-1b, col_values=(('qos', UUID('f352dd7f-2842-49ff-8854-b523f9599402')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94c36018-1b, col_values=(('external_ids', {'iface-id': '94c36018-1bad-44d2-b2e1-cd28794ffa68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:41:73', 'vm-uuid': '0c43e735-ec5b-4292-805c-2f172b72b16b'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:04 user nova-compute[75438]: INFO os_vif [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b')
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] No VIF found with MAC fa:16:3e:68:41:73, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Updated VIF entry in instance network info cache for port 94c36018-1bad-44d2-b2e1-cd28794ffa68. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:32:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Updating instance_info_cache with network_info: [{"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8433833a-8c32-4c03-9a29-4cf583108de8 req-d6ecb547-4545-4030-a080-579c5fa6b767 service nova] Releasing lock "refresh_cache-0c43e735-ec5b-4292-805c-2f172b72b16b" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc3cc52c-285d-46e9-8063-db8eb7166038 req-e7ca3692-248a-47ff-b919-9c0b322814d4 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc3cc52c-285d-46e9-8063-db8eb7166038 req-e7ca3692-248a-47ff-b919-9c0b322814d4 service nova] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc3cc52c-285d-46e9-8063-db8eb7166038 req-e7ca3692-248a-47ff-b919-9c0b322814d4 service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc3cc52c-285d-46e9-8063-db8eb7166038 req-e7ca3692-248a-47ff-b919-9c0b322814d4 service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc3cc52c-285d-46e9-8063-db8eb7166038 req-e7ca3692-248a-47ff-b919-9c0b322814d4 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] No waiting events found dispatching network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:06 user nova-compute[75438]: WARNING nova.compute.manager [req-dc3cc52c-285d-46e9-8063-db8eb7166038 req-e7ca3692-248a-47ff-b919-9c0b322814d4 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received unexpected event network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 for instance with vm_state building and task_state spawning.
Nov 09 02:32:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:32:08 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Instance spawned successfully.
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-83105cd0-ef70-4b6b-be4f-c074b733a0ab req-8c73b28f-4e52-47cd-8e09-2d3c5cb299bd service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-83105cd0-ef70-4b6b-be4f-c074b733a0ab req-8c73b28f-4e52-47cd-8e09-2d3c5cb299bd service nova] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-83105cd0-ef70-4b6b-be4f-c074b733a0ab req-8c73b28f-4e52-47cd-8e09-2d3c5cb299bd service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-83105cd0-ef70-4b6b-be4f-c074b733a0ab req-8c73b28f-4e52-47cd-8e09-2d3c5cb299bd service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-83105cd0-ef70-4b6b-be4f-c074b733a0ab req-8c73b28f-4e52-47cd-8e09-2d3c5cb299bd service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] No waiting events found dispatching network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:08 user nova-compute[75438]: WARNING nova.compute.manager [req-83105cd0-ef70-4b6b-be4f-c074b733a0ab req-8c73b28f-4e52-47cd-8e09-2d3c5cb299bd service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received unexpected event network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 for instance with vm_state building and task_state spawning.
Nov 09 02:32:08 user nova-compute[75438]: INFO nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 09 02:32:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:32:08 user nova-compute[75438]: INFO nova.compute.manager [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Took 6.09 seconds to build instance.
Nov 09 02:32:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-89badbfb-c09b-4b50-b2ee-7658620e3035 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.264s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-changed-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Refreshing instance network info cache due to event network-changed-8c28c2d5-a1d0-4e23-8203-f01931608a8f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:32:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] Acquiring lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:32:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] Acquired lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:32:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Refreshing network info cache for port 8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "074d5809-da5f-4158-83e1-651c8518efaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:14 user nova-compute[75438]: INFO nova.compute.manager [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Terminating instance
Nov 09 02:32:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG nova.network.neutron [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updated VIF entry in instance network info cache for port 8c28c2d5-a1d0-4e23-8203-f01931608a8f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG nova.network.neutron [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updating instance_info_cache with network_info: [{"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b44fb0f8-e554-44e9-a295-2289de771c57 req-f4f04727-7f89-4ab4-b90e-9de5140f5c74 service nova] Releasing lock "refresh_cache-92b346f1-c9a2-4ac6-817f-e47c02259715" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-56211ed6-29f7-494b-afee-29d385e6871e req-6057df8a-7391-4d44-9f83-35632c08aed7 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-56211ed6-29f7-494b-afee-29d385e6871e req-6057df8a-7391-4d44-9f83-35632c08aed7 service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-56211ed6-29f7-494b-afee-29d385e6871e req-6057df8a-7391-4d44-9f83-35632c08aed7 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-56211ed6-29f7-494b-afee-29d385e6871e req-6057df8a-7391-4d44-9f83-35632c08aed7 service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-56211ed6-29f7-494b-afee-29d385e6871e req-6057df8a-7391-4d44-9f83-35632c08aed7 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-56211ed6-29f7-494b-afee-29d385e6871e req-6057df8a-7391-4d44-9f83-35632c08aed7 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-unplugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:32:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Instance destroyed successfully.
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.objects.instance [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'resources' on Instance uuid 074d5809-da5f-4158-83e1-651c8518efaa {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:13:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1756521678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1756521678',id=24,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-83kov24h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:18:32Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=074d5809-da5f-4158-83e1-651c8518efaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "address": "fa:16:3e:be:3b:a4", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de9abc9-2a", "ovs_interfaceid": "3de9abc9-2ac0-4e53-926c-bc0731e2c325", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_vif [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de9abc9-2a, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fba1935c-aac0-4338-aa7f-6f302b9dc99d) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:32:15 user nova-compute[75438]: INFO os_vif [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:3b:a4,bridge_name='br-int',has_traffic_filtering=True,id=3de9abc9-2ac0-4e53-926c-bc0731e2c325,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de9abc9-2a')
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZIcvDzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:32:15 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ced566-5a17-4b69-b895-c1271520a25f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:32:15 user nova-compute[75438]: No targets found.
Nov 09 02:32:15 user nova-compute[75438]: iSNS:
Nov 09 02:32:15 user nova-compute[75438]: No targets found.
Nov 09 02:32:15 user nova-compute[75438]: STATIC:
Nov 09 02:32:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13
Nov 09 02:32:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:32:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:32:15 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0
Nov 09 02:32:15 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:32:15 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:32:15 user nova-compute[75438]: FIRMWARE:
Nov 09 02:32:15 user nova-compute[75438]: No targets found.
Nov 09 02:32:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:32:15 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:32:15 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a01069-052f-4fb4-8d0f-7522bfd9cc7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbdac9e-7364-469c-b17c-37bb35522d4f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:32:15 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 (non-flash)
Nov 09 02:32:15 user nova-compute[75438]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba043dac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13'): ({'sdf'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Removing single pathed devices sdf {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79194775-f9ff-4d9e-be53-6731dc09b565]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[deba8f51-621d-4352-8288-a8aa1baf3c5a]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Flushing IO for device /dev/sdf {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1243b526-75b3-432d-85d5-c92949a2d513]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323e7ba-5726-47ec-8609-06d882518dae]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] SCSI volumes sdf have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[09228829-af8b-4f2d-9605-0acb1c145d43]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[36611e95-3123-48e5-a6f5-564c16e7e821]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260]
Nov 09 02:32:15 user nova-compute[75438]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13, portal: 172.16.0.220,3260] successful.
Nov 09 02:32:15 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b7a65b1-5262-4943-b932-ae673dbf5d13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7692da0c-148e-4e87-8764-5a9c5224b9ae]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] <== disconnect_volume: return (303ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:32:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Deleting instance files /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa_del
Nov 09 02:32:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Deletion of /opt/stack/data/nova/instances/074d5809-da5f-4158-83e1-651c8518efaa_del complete
Nov 09 02:32:15 user nova-compute[75438]: INFO nova.compute.manager [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 09 02:32:15 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:15 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Took 0.37 seconds to deallocate network for instance.
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-5a2fd853-db41-4bfb-9cc5-8538a43fc4f8 req-524faaa4-3335-4892-9ba8-042ffdf04bf9 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-deleted-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:15 user nova-compute[75438]: INFO nova.compute.manager [req-5a2fd853-db41-4bfb-9cc5-8538a43fc4f8 req-524faaa4-3335-4892-9ba8-042ffdf04bf9 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Neutron deleted interface 3de9abc9-2ac0-4e53-926c-bc0731e2c325; detaching it from the instance and deleting it from the info cache
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.network.neutron [req-5a2fd853-db41-4bfb-9cc5-8538a43fc4f8 req-524faaa4-3335-4892-9ba8-042ffdf04bf9 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-5a2fd853-db41-4bfb-9cc5-8538a43fc4f8 req-524faaa4-3335-4892-9ba8-042ffdf04bf9 service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Detach interface failed, port_id=3de9abc9-2ac0-4e53-926c-bc0731e2c325, reason: Instance 074d5809-da5f-4158-83e1-651c8518efaa could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-c896acb2-513a-4bd6-8a64-e8820ad293e8 req-b372c3a5-5333-4733-ab25-bcc47cddbd8d service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c896acb2-513a-4bd6-8a64-e8820ad293e8 req-b372c3a5-5333-4733-ab25-bcc47cddbd8d service nova] Acquiring lock "074d5809-da5f-4158-83e1-651c8518efaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c896acb2-513a-4bd6-8a64-e8820ad293e8 req-b372c3a5-5333-4733-ab25-bcc47cddbd8d service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c896acb2-513a-4bd6-8a64-e8820ad293e8 req-b372c3a5-5333-4733-ab25-bcc47cddbd8d service nova] Lock "074d5809-da5f-4158-83e1-651c8518efaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-c896acb2-513a-4bd6-8a64-e8820ad293e8 req-b372c3a5-5333-4733-ab25-bcc47cddbd8d service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] No waiting events found dispatching network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:16 user nova-compute[75438]: WARNING nova.compute.manager [req-c896acb2-513a-4bd6-8a64-e8820ad293e8 req-b372c3a5-5333-4733-ab25-bcc47cddbd8d service nova] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Received unexpected event network-vif-plugged-3de9abc9-2ac0-4e53-926c-bc0731e2c325 for instance with vm_state active and task_state deleting.
Nov 09 02:32:16 user nova-compute[75438]: INFO nova.compute.manager [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 074d5809-da5f-4158-83e1-651c8518efaa] Took 0.95 seconds to detach 1 volumes for instance.
Nov 09 02:32:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:17 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:32:17 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:32:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:17 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Deleted allocations for instance 074d5809-da5f-4158-83e1-651c8518efaa
Nov 09 02:32:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-979219a9-5070-43d7-bd0d-c281afacf533 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "074d5809-da5f-4158-83e1-651c8518efaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.099s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:20 user nova-compute[75438]: DEBUG nova.objects.instance [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid 92b346f1-c9a2-4ac6-817f-e47c02259715 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:32:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:21 user nova-compute[75438]: INFO nova.compute.manager [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Attaching volume 6e8ac540-d9ef-4250-af03-b31c86a055f1 to /dev/vdb
Nov 09 02:32:21 user nova-compute[75438]: DEBUG os_brick.utils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39e0cbb-51cc-468f-a175-b45e44aade8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c19de1c-1005-46f6-b6a5-10e1b0f5c60b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[063de0f6-a097-4f34-a25c-f802392c4d0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf358d-418d-40a6-b5ce-fe36fa78605a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:32:21 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:32:21 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a1fc81-5d9d-46bb-92a2-87678d7c02ce]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG os_brick.utils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:32:21 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updating existing volume attachment record: 5742328d-1b58-45b1-9c88-79dd940396db {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:32:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:32:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:32:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:32:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:32:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updating instance_info_cache with network_info: [{"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-16336dee-4c57-4e22-9ece-a67e8846b507" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:32:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:32:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:42 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:32:42 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=24.86425018310547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 16336dee-4c57-4e22-9ece-a67e8846b507 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 92b346f1-c9a2-4ac6-817f-e47c02259715 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0c43e735-ec5b-4292-805c-2f172b72b16b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:32:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTLhVeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:32:43 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:32:43 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:32:43 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8509a16-1df8-471e-8d0d-25b48c9f7efb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:32:43 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be80d1c-197c-4127-9264-4a9cc0f10f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1] added
Nov 09 02:32:43 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[185e46c0-e092-4571-8dc3-78f227e93378]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baff17-5b75-4aae-a5e1-9ab8f5da80d7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTLhVeqr {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTLhVeqr" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ca84ae-2fca-4667-b7f2-ebba6e0cf2c7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTLhVeqr'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[177b8723-e1eb-460d-b0ef-2baa892a0638]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06eaf56-4ef7-4cab-a374-23789755059b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:43 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:43 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[352188a7-004b-4766-98b8-0304757f0689]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260]
Nov 09 02:32:43 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260] successful.
Nov 09 02:32:43 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfb2c1b-3d97-4114-8192-823e26e27529]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11df3835-066f-4088-b1dd-25c45c905121]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:43 user nova-compute[75438]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)
Nov 09 02:32:43 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:43 user nova-compute[75438]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)
Nov 09 02:32:43 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:32:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c6c7e-ad2f-4c4a-b8b3-63a643efc421]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTLhVeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26534383766656136', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534383766656136', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG nova.objects.instance [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid 92b346f1-c9a2-4ac6-817f-e47c02259715 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:32:45 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:32:45 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:32:45 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:32:45 user nova-compute[75438]:   <serial>6e8ac540-d9ef-4250-af03-b31c86a055f1</serial>
Nov 09 02:32:45 user nova-compute[75438]: </disk>
Nov 09 02:32:45 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] No VIF found with MAC fa:16:3e:f1:d8:4d, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-12820391-f1b8-4c5c-aed0-c561d8fd00a5 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.713s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:46 user nova-compute[75438]: INFO nova.compute.manager [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Detaching volume 6e8ac540-d9ef-4250-af03-b31c86a055f1
Nov 09 02:32:47 user nova-compute[75438]: INFO nova.virt.block_device [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Attempting to driver detach volume 6e8ac540-d9ef-4250-af03-b31c86a055f1 from mountpoint /dev/vdb
Nov 09 02:32:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Attempting to detach device vdb from instance 92b346f1-c9a2-4ac6-817f-e47c02259715 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:32:47 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:32:47 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:32:47 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:32:47 user nova-compute[75438]:   <serial>6e8ac540-d9ef-4250-af03-b31c86a055f1</serial>
Nov 09 02:32:47 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:32:47 user nova-compute[75438]: </disk>
Nov 09 02:32:47 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:32:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully detached device vdb from instance 92b346f1-c9a2-4ac6-817f-e47c02259715 from the persistent domain config.
Nov 09 02:32:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92b346f1-c9a2-4ac6-817f-e47c02259715 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:32:47 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:32:47 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:32:47 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:32:47 user nova-compute[75438]:   <serial>6e8ac540-d9ef-4250-af03-b31c86a055f1</serial>
Nov 09 02:32:47 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:32:47 user nova-compute[75438]: </disk>
Nov 09 02:32:47 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92b346f1-c9a2-4ac6-817f-e47c02259715 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "16336dee-4c57-4e22-9ece-a67e8846b507" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:47 user nova-compute[75438]: INFO nova.compute.manager [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Terminating instance
Nov 09 02:32:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-2b8c8516-50c2-425a-9edd-a2d4ec04097a req-ff4cdae0-15a2-46f7-ade4-6fa2069c9493 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-unplugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2b8c8516-50c2-425a-9edd-a2d4ec04097a req-ff4cdae0-15a2-46f7-ade4-6fa2069c9493 service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2b8c8516-50c2-425a-9edd-a2d4ec04097a req-ff4cdae0-15a2-46f7-ade4-6fa2069c9493 service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2b8c8516-50c2-425a-9edd-a2d4ec04097a req-ff4cdae0-15a2-46f7-ade4-6fa2069c9493 service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-2b8c8516-50c2-425a-9edd-a2d4ec04097a req-ff4cdae0-15a2-46f7-ade4-6fa2069c9493 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-unplugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-2b8c8516-50c2-425a-9edd-a2d4ec04097a req-ff4cdae0-15a2-46f7-ade4-6fa2069c9493 service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-unplugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Instance destroyed successfully.
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'resources' on Instance uuid 16336dee-4c57-4e22-9ece-a67e8846b507 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-799104561',display_name='tempest-TestVolumeBootPattern-volume-backed-server-799104561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-799104561',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2JPTniliEobTua9nd1x1oIkCUySIqAc2OQ+qmZLSN6ismt+9W9bPV1nDTWGMTeqDU7J7j4ruERBI83W7GTPn1MlLao8KcHDqgiHXRjOk9AKUgaKWYACN3X+8UIU912MQ==',key_name='tempest-keypair-1832962067',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-ux005pso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:27:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b5297e15fd14f1395cb606e791c4202',uuid=16336dee-4c57-4e22-9ece-a67e8846b507,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "address": "fa:16:3e:b2:5a:0e", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3c4e3d-d7", "ovs_interfaceid": "7d3c4e3d-d7e6-430b-b7ff-6127035d882d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_vif [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d3c4e3d-d7, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cc0e4aa-120a-41f4-be37-851951b85c3c) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: INFO os_vif [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:5a:0e,bridge_name='br-int',has_traffic_filtering=True,id=7d3c4e3d-d7e6-430b-b7ff-6127035d882d,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3c4e3d-d7')
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZrlXST', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:32:48 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e635250-5dce-4115-9d35-e7491a1c7705]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:32:48 user nova-compute[75438]: No targets found.
Nov 09 02:32:48 user nova-compute[75438]: iSNS:
Nov 09 02:32:48 user nova-compute[75438]: No targets found.
Nov 09 02:32:48 user nova-compute[75438]: STATIC:
Nov 09 02:32:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1
Nov 09 02:32:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:32:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:32:48 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0
Nov 09 02:32:48 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:32:48 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:32:48 user nova-compute[75438]: FIRMWARE:
Nov 09 02:32:48 user nova-compute[75438]: No targets found.
Nov 09 02:32:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:32:48 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:32:48 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd8e75-86ee-4992-bdea-f4913b03bca3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0824dfb-3d49-4d60-858f-2dfd81fb5190]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:48 user nova-compute[75438]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)
Nov 09 02:32:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 (non-flash)
Nov 09 02:32:48 user nova-compute[75438]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)
Nov 09 02:32:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba044aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0'): ({'sdg'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Removing single pathed devices sdg {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cea069-9077-43c9-b196-5ed72318e98f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f720a-0ae1-4865-a18b-a997cae0dc73]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flushing IO for device /dev/sdg {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d493798b-c76c-43f9-85ee-418172fcc97f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9da72b8-39c9-43df-bb4d-08b0274b69b2]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] SCSI volumes sdg have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b3a53-1ebf-438a-8d55-d39bffbdf9bf]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c63c8b-659d-4898-b5c3-d265686f43b9]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260]
Nov 09 02:32:48 user nova-compute[75438]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0, portal: 172.16.0.220,3260] successful.
Nov 09 02:32:48 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61f6892c-2b84-4d81-853b-a5fb77691eb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[29de5f75-5fff-4999-9ba7-edc21ecc4f8b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== disconnect_volume: return (385ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:32:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Deleting instance files /opt/stack/data/nova/instances/16336dee-4c57-4e22-9ece-a67e8846b507_del
Nov 09 02:32:48 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Deletion of /opt/stack/data/nova/instances/16336dee-4c57-4e22-9ece-a67e8846b507_del complete
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:48 user nova-compute[75438]: INFO nova.compute.manager [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 09 02:32:48 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:49 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:32:49 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Took 0.76 seconds to deallocate network for instance.
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:50 user nova-compute[75438]: WARNING nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received unexpected event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with vm_state active and task_state deleting.
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:50 user nova-compute[75438]: WARNING nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received unexpected event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with vm_state active and task_state deleting.
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:50 user nova-compute[75438]: WARNING nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received unexpected event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with vm_state active and task_state deleting.
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-unplugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-unplugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-unplugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Acquiring lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] Lock "16336dee-4c57-4e22-9ece-a67e8846b507-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] No waiting events found dispatching network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:32:50 user nova-compute[75438]: WARNING nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received unexpected event network-vif-plugged-7d3c4e3d-d7e6-430b-b7ff-6127035d882d for instance with vm_state active and task_state deleting.
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-b91ebe83-ca4a-4920-a6c4-d6e7222c98f4 req-3e5f2122-e627-4b72-8094-0afb0b8c769e service nova] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Received event network-vif-deleted-7d3c4e3d-d7e6-430b-b7ff-6127035d882d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:32:50 user nova-compute[75438]: INFO nova.compute.manager [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Took 0.90 seconds to detach 1 volumes for instance.
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 16336dee-4c57-4e22-9ece-a67e8846b507] Deleting volume: 61f6892c-2b84-4d81-853b-a5fb77691eb0 {{(pid=75438) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:50 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Deleted allocations for instance 16336dee-4c57-4e22-9ece-a67e8846b507
Nov 09 02:32:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b55fe3e3-b6ec-4d33-ab3c-b01e1a3a6738 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "16336dee-4c57-4e22-9ece-a67e8846b507" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.396s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:32:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:32:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:32:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:33:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:05 user nova-compute[75438]: INFO nova.compute.manager [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Terminating instance
Nov 09 02:33:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG nova.compute.manager [req-eeb9c96c-4538-4ed8-b7ef-25be74377c00 req-a90876aa-6f50-4ec7-89bb-e8415927a9bc service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-vif-unplugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eeb9c96c-4538-4ed8-b7ef-25be74377c00 req-a90876aa-6f50-4ec7-89bb-e8415927a9bc service nova] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eeb9c96c-4538-4ed8-b7ef-25be74377c00 req-a90876aa-6f50-4ec7-89bb-e8415927a9bc service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eeb9c96c-4538-4ed8-b7ef-25be74377c00 req-a90876aa-6f50-4ec7-89bb-e8415927a9bc service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG nova.compute.manager [req-eeb9c96c-4538-4ed8-b7ef-25be74377c00 req-a90876aa-6f50-4ec7-89bb-e8415927a9bc service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] No waiting events found dispatching network-vif-unplugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:33:05 user nova-compute[75438]: DEBUG nova.compute.manager [req-eeb9c96c-4538-4ed8-b7ef-25be74377c00 req-a90876aa-6f50-4ec7-89bb-e8415927a9bc service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-vif-unplugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:33:05 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Instance destroyed successfully.
Nov 09 02:33:05 user nova-compute[75438]: DEBUG nova.objects.instance [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lazy-loading 'resources' on Instance uuid 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-205438585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-205438585',id=17,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:11:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7d490c388e64d5fbdeec47eb532482e',ramdisk_id='',reservation_id='r-930epdk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:12:52Z,user_data=None,user_id='3160dcb696a24d3db8bd3a22064cbd7a',uuid=7d8acf4e-7bc3-4302-8966-326bcc45ebf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converting VIF {"id": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "address": "fa:16:3e:e5:c1:1b", "network": {"id": "a75a7d88-f94b-4e22-9a29-efcaa8933a44", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1004785927-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7d490c388e64d5fbdeec47eb532482e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed89336-34", "ovs_interfaceid": "6ed89336-3495-4c32-b2c6-70bff90e6b21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG os_vif [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed89336-34, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6dfb0a7-793e-4cd1-8b3e-a1a4af1426ab) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:06 user nova-compute[75438]: INFO os_vif [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:c1:1b,bridge_name='br-int',has_traffic_filtering=True,id=6ed89336-3495-4c32-b2c6-70bff90e6b21,network=Network(a75a7d88-f94b-4e22-9a29-efcaa8933a44),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed89336-34')
Nov 09 02:33:06 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Deleting instance files /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7_del
Nov 09 02:33:06 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Deletion of /opt/stack/data/nova/instances/7d8acf4e-7bc3-4302-8966-326bcc45ebf7_del complete
Nov 09 02:33:06 user nova-compute[75438]: INFO nova.compute.manager [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 02:33:06 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:33:06 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Took 0.39 seconds to deallocate network for instance.
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-656a0cab-56f0-46bb-911e-bf5944cf00b4 req-b1d08877-69ec-478b-b349-55b25710fe1f service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-vif-deleted-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:06 user nova-compute[75438]: INFO nova.compute.manager [req-656a0cab-56f0-46bb-911e-bf5944cf00b4 req-b1d08877-69ec-478b-b349-55b25710fe1f service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Neutron deleted interface 6ed89336-3495-4c32-b2c6-70bff90e6b21; detaching it from the instance and deleting it from the info cache
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.network.neutron [req-656a0cab-56f0-46bb-911e-bf5944cf00b4 req-b1d08877-69ec-478b-b349-55b25710fe1f service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-656a0cab-56f0-46bb-911e-bf5944cf00b4 req-b1d08877-69ec-478b-b349-55b25710fe1f service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Detach interface failed, port_id=6ed89336-3495-4c32-b2c6-70bff90e6b21, reason: Instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:33:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:06 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Deleted allocations for instance 7d8acf4e-7bc3-4302-8966-326bcc45ebf7
Nov 09 02:33:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-cc47b841-9dd6-4eae-aa01-6fab8ae58035 tempest-ServerBootFromVolumeStableRescueTest-1794136160 tempest-ServerBootFromVolumeStableRescueTest-1794136160-project-member] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.610s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:07 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92b346f1-c9a2-4ac6-817f-e47c02259715 is timed out.
Nov 09 02:33:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully detached device vdb from instance 92b346f1-c9a2-4ac6-817f-e47c02259715 from the live domain config.
Nov 09 02:33:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTLhVeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:33:07 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beb326f-14f8-4906-8df7-06e7aa32f67e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:33:07 user nova-compute[75438]: No targets found.
Nov 09 02:33:07 user nova-compute[75438]: iSNS:
Nov 09 02:33:07 user nova-compute[75438]: No targets found.
Nov 09 02:33:07 user nova-compute[75438]: STATIC:
Nov 09 02:33:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1
Nov 09 02:33:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:33:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:33:07 user nova-compute[75438]: FIRMWARE:
Nov 09 02:33:07 user nova-compute[75438]: No targets found.
Nov 09 02:33:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:33:07 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:33:07 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f7627-42ac-436f-a2f9-2c0d2c81a0c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee864f-6b21-401b-a80e-16fba7f04dd3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)
Nov 09 02:33:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 (non-flash)
Nov 09 02:33:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245985e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cae743a-788c-4bf1-b598-e11830a599fe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[120fb75b-1dfb-4378-a2e6-3301820127b0]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aabef5-080b-4948-89a8-dd4d767b737f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-82a418bf-dd48-431f-9917-ae0e39ffee73 req-7c6c5724-895f-484b-8f5b-538363dd29a8 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received event network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82a418bf-dd48-431f-9917-ae0e39ffee73 req-7c6c5724-895f-484b-8f5b-538363dd29a8 service nova] Acquiring lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82a418bf-dd48-431f-9917-ae0e39ffee73 req-7c6c5724-895f-484b-8f5b-538363dd29a8 service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-82a418bf-dd48-431f-9917-ae0e39ffee73 req-7c6c5724-895f-484b-8f5b-538363dd29a8 service nova] Lock "7d8acf4e-7bc3-4302-8966-326bcc45ebf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-82a418bf-dd48-431f-9917-ae0e39ffee73 req-7c6c5724-895f-484b-8f5b-538363dd29a8 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] No waiting events found dispatching network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:33:07 user nova-compute[75438]: WARNING nova.compute.manager [req-82a418bf-dd48-431f-9917-ae0e39ffee73 req-7c6c5724-895f-484b-8f5b-538363dd29a8 service nova] [instance: 7d8acf4e-7bc3-4302-8966-326bcc45ebf7] Received unexpected event network-vif-plugged-6ed89336-3495-4c32-b2c6-70bff90e6b21 for instance with vm_state deleted and task_state None.
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e90ad36-ff4a-4c5e-824b-7e6173aa9b2d]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[16433c59-8742-4870-a343-cf2f0c901f84]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9682fd1-312a-4952-8743-a08b443f2123]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260]
Nov 09 02:33:07 user nova-compute[75438]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1, portal: 172.16.0.220,3260] successful.
Nov 09 02:33:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e8ac540-d9ef-4250-af03-b31c86a055f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cc7b01-e51b-423b-bf8f-c0b85ca48b04]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] <== disconnect_volume: return (292ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:33:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:33:08 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'flavor' on Instance uuid 92b346f1-c9a2-4ac6-817f-e47c02259715 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:33:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d62aceb6-8082-47e3-8f97-4c46cb657401 tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:33:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:33:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:33:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:37 user nova-compute[75438]: INFO nova.compute.manager [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Terminating instance
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-60662f54-387e-4c64-aafc-5939bfbfaa3f req-33cc408f-9ca4-4bed-a652-cdc459e64658 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-vif-unplugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-60662f54-387e-4c64-aafc-5939bfbfaa3f req-33cc408f-9ca4-4bed-a652-cdc459e64658 service nova] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-60662f54-387e-4c64-aafc-5939bfbfaa3f req-33cc408f-9ca4-4bed-a652-cdc459e64658 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-60662f54-387e-4c64-aafc-5939bfbfaa3f req-33cc408f-9ca4-4bed-a652-cdc459e64658 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-60662f54-387e-4c64-aafc-5939bfbfaa3f req-33cc408f-9ca4-4bed-a652-cdc459e64658 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] No waiting events found dispatching network-vif-unplugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-60662f54-387e-4c64-aafc-5939bfbfaa3f req-33cc408f-9ca4-4bed-a652-cdc459e64658 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-vif-unplugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Skipping network cache update for instance because it is being deleted. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Instance destroyed successfully.
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.objects.instance [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lazy-loading 'resources' on Instance uuid 92b346f1-c9a2-4ac6-817f-e47c02259715 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2070077868',display_name='tempest-AttachVolumeNegativeTest-server-2070077868',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2070077868',id=40,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6l7SChDM4Bo1YeIU7T6WGaYLrEWXvXD9i3O8or3sY9bUCrVXQOjK3/hgbM6QfMM5+UewKmGSylMQKnfJ/yEwJAIfb00R2J4k5dVoji0U+1YR6gPgRMqZGQHLw+4r4Pkg==',key_name='tempest-keypair-2041839532',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='374722030e844844b670f169c722977c',ramdisk_id='',reservation_id='r-epdz4kv1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1037659816',owner_user_name='tempest-AttachVolumeNegativeTest-1037659816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f241dbd509b4beb8148222f8379d58e',uuid=92b346f1-c9a2-4ac6-817f-e47c02259715,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converting VIF {"id": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "address": "fa:16:3e:f1:d8:4d", "network": {"id": "eccb526b-5327-4cf4-a2ad-70544872058c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-498467854-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "374722030e844844b670f169c722977c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c28c2d5-a1", "ovs_interfaceid": "8c28c2d5-a1d0-4e23-8203-f01931608a8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG os_vif [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c28c2d5-a1, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffd2bbfa-48b8-4f1f-b5f6-10784b296768) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:38 user nova-compute[75438]: INFO os_vif [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d8:4d,bridge_name='br-int',has_traffic_filtering=True,id=8c28c2d5-a1d0-4e23-8203-f01931608a8f,network=Network(eccb526b-5327-4cf4-a2ad-70544872058c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c28c2d5-a1')
Nov 09 02:33:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Deleting instance files /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715_del
Nov 09 02:33:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Deletion of /opt/stack/data/nova/instances/92b346f1-c9a2-4ac6-817f-e47c02259715_del complete
Nov 09 02:33:38 user nova-compute[75438]: INFO nova.compute.manager [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 09 02:33:38 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:33:38 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Took 0.64 seconds to deallocate network for instance.
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-c3b3efe3-b9d8-49c5-b4be-4ae1445915f7 req-49af96e9-d55b-467b-9f3a-4dc08d41c450 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-vif-deleted-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:38 user nova-compute[75438]: INFO nova.compute.manager [req-c3b3efe3-b9d8-49c5-b4be-4ae1445915f7 req-49af96e9-d55b-467b-9f3a-4dc08d41c450 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Neutron deleted interface 8c28c2d5-a1d0-4e23-8203-f01931608a8f; detaching it from the instance and deleting it from the info cache
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-c3b3efe3-b9d8-49c5-b4be-4ae1445915f7 req-49af96e9-d55b-467b-9f3a-4dc08d41c450 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-c3b3efe3-b9d8-49c5-b4be-4ae1445915f7 req-49af96e9-d55b-467b-9f3a-4dc08d41c450 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Detach interface failed, port_id=8c28c2d5-a1d0-4e23-8203-f01931608a8f, reason: Instance 92b346f1-c9a2-4ac6-817f-e47c02259715 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:33:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:39 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Deleted allocations for instance 92b346f1-c9a2-4ac6-817f-e47c02259715
Nov 09 02:33:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-815ab268-b4e6-4865-b053-2c0fcdf9fb1f tempest-AttachVolumeNegativeTest-1037659816 tempest-AttachVolumeNegativeTest-1037659816-project-member] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.814s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-a42eb882-b1db-4b1c-b888-91215d2aaab2 req-df863f80-d5a3-4c00-b35e-0642988b28e5 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received event network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a42eb882-b1db-4b1c-b888-91215d2aaab2 req-df863f80-d5a3-4c00-b35e-0642988b28e5 service nova] Acquiring lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a42eb882-b1db-4b1c-b888-91215d2aaab2 req-df863f80-d5a3-4c00-b35e-0642988b28e5 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a42eb882-b1db-4b1c-b888-91215d2aaab2 req-df863f80-d5a3-4c00-b35e-0642988b28e5 service nova] Lock "92b346f1-c9a2-4ac6-817f-e47c02259715-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-a42eb882-b1db-4b1c-b888-91215d2aaab2 req-df863f80-d5a3-4c00-b35e-0642988b28e5 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] No waiting events found dispatching network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:33:39 user nova-compute[75438]: WARNING nova.compute.manager [req-a42eb882-b1db-4b1c-b888-91215d2aaab2 req-df863f80-d5a3-4c00-b35e-0642988b28e5 service nova] [instance: 92b346f1-c9a2-4ac6-817f-e47c02259715] Received unexpected event network-vif-plugged-8c28c2d5-a1d0-4e23-8203-f01931608a8f for instance with vm_state deleted and task_state None.
Nov 09 02:33:42 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:33:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:33:43 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:33:43 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=25.007606506347656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 0c43e735-ec5b-4292-805c-2f172b72b16b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:33:43 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:33:44 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:33:44 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:33:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:33:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:33:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:33:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:52 user nova-compute[75438]: INFO nova.compute.manager [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Terminating instance
Nov 09 02:33:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-6c200928-8aeb-45bd-a625-2ff3fa846e5a req-b2090017-549a-497b-8c89-4f4f76e67770 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-vif-unplugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6c200928-8aeb-45bd-a625-2ff3fa846e5a req-b2090017-549a-497b-8c89-4f4f76e67770 service nova] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6c200928-8aeb-45bd-a625-2ff3fa846e5a req-b2090017-549a-497b-8c89-4f4f76e67770 service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6c200928-8aeb-45bd-a625-2ff3fa846e5a req-b2090017-549a-497b-8c89-4f4f76e67770 service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-6c200928-8aeb-45bd-a625-2ff3fa846e5a req-b2090017-549a-497b-8c89-4f4f76e67770 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] No waiting events found dispatching network-vif-unplugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-6c200928-8aeb-45bd-a625-2ff3fa846e5a req-b2090017-549a-497b-8c89-4f4f76e67770 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-vif-unplugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Instance destroyed successfully.
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.objects.instance [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lazy-loading 'resources' on Instance uuid 0c43e735-ec5b-4292-805c-2f172b72b16b {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:32:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1178181200',display_name='tempest-VolumesActionsTest-instance-1178181200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1178181200',id=41,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:32:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c03978fbf1934a1ebdefb24a585d59d6',ramdisk_id='',reservation_id='r-hvat40ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-146170135',owner_user_name='tempest-VolumesActionsTest-146170135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:32:09Z,user_data=None,user_id='07c96c13758649518ea50354b3fe3eab',uuid=0c43e735-ec5b-4292-805c-2f172b72b16b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converting VIF {"id": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "address": "fa:16:3e:68:41:73", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94c36018-1b", "ovs_interfaceid": "94c36018-1bad-44d2-b2e1-cd28794ffa68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG os_vif [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94c36018-1b, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f352dd7f-2842-49ff-8854-b523f9599402) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:33:53 user nova-compute[75438]: INFO os_vif [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:41:73,bridge_name='br-int',has_traffic_filtering=True,id=94c36018-1bad-44d2-b2e1-cd28794ffa68,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94c36018-1b')
Nov 09 02:33:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Deleting instance files /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b_del
Nov 09 02:33:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Deletion of /opt/stack/data/nova/instances/0c43e735-ec5b-4292-805c-2f172b72b16b_del complete
Nov 09 02:33:53 user nova-compute[75438]: INFO nova.compute.manager [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 09 02:33:53 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:33:53 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:33:54 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Took 0.40 seconds to deallocate network for instance.
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-a53cc313-270d-42c8-ac1e-3c79e4773111 req-b437b995-6dd7-4e05-9456-c12f03135e2a service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-vif-deleted-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:54 user nova-compute[75438]: INFO nova.compute.manager [req-a53cc313-270d-42c8-ac1e-3c79e4773111 req-b437b995-6dd7-4e05-9456-c12f03135e2a service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Neutron deleted interface 94c36018-1bad-44d2-b2e1-cd28794ffa68; detaching it from the instance and deleting it from the info cache
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.network.neutron [req-a53cc313-270d-42c8-ac1e-3c79e4773111 req-b437b995-6dd7-4e05-9456-c12f03135e2a service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-a53cc313-270d-42c8-ac1e-3c79e4773111 req-b437b995-6dd7-4e05-9456-c12f03135e2a service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Detach interface failed, port_id=94c36018-1bad-44d2-b2e1-cd28794ffa68, reason: Instance 0c43e735-ec5b-4292-805c-2f172b72b16b could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:54 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Deleted allocations for instance 0c43e735-ec5b-4292-805c-2f172b72b16b
Nov 09 02:33:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-7f0ec171-66b5-4798-bfcb-e791aac7307b tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.944s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:33:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:33:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-db2a7795-5673-4ebc-a84e-da9841401b80 req-0e9368b2-c21e-43df-966a-ee7992fb1750 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received event network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:33:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-db2a7795-5673-4ebc-a84e-da9841401b80 req-0e9368b2-c21e-43df-966a-ee7992fb1750 service nova] Acquiring lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:33:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-db2a7795-5673-4ebc-a84e-da9841401b80 req-0e9368b2-c21e-43df-966a-ee7992fb1750 service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:33:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-db2a7795-5673-4ebc-a84e-da9841401b80 req-0e9368b2-c21e-43df-966a-ee7992fb1750 service nova] Lock "0c43e735-ec5b-4292-805c-2f172b72b16b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:33:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-db2a7795-5673-4ebc-a84e-da9841401b80 req-0e9368b2-c21e-43df-966a-ee7992fb1750 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] No waiting events found dispatching network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:33:55 user nova-compute[75438]: WARNING nova.compute.manager [req-db2a7795-5673-4ebc-a84e-da9841401b80 req-0e9368b2-c21e-43df-966a-ee7992fb1750 service nova] [instance: 0c43e735-ec5b-4292-805c-2f172b72b16b] Received unexpected event network-vif-plugged-94c36018-1bad-44d2-b2e1-cd28794ffa68 for instance with vm_state deleted and task_state None.
Nov 09 02:33:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:33:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:33:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "a1a29106-1152-4451-98ac-a84a6539dff3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:34:01 user nova-compute[75438]: INFO nova.compute.claims [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Claim successful on node user
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:34:01 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:34:01 user nova-compute[75438]: INFO nova.virt.block_device [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Booting with volume 6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b at /dev/vda
Nov 09 02:34:01 user nova-compute[75438]: DEBUG os_brick.utils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8807fe48-2eac-42b7-82fd-7c7f182a0ea6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.policy [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5297e15fd14f1395cb606e791c4202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c21c58de14dbda4534441cad48918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[022516e2-00ee-437d-a05c-fea70d7be8ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8105582-7128-4f16-b11a-10e94357c8f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cbeaf7-9302-4354-b204-e796a1024458]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:34:01 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:34:01 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c8df4-4c8f-4ee2-bd32-fb597463a03a]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG os_brick.utils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:34:01 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updating existing volume attachment record: b43d2a76-7b76-4d87-ab8a-58ef0fb31f59 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:34:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Successfully created port: 0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:34:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Successfully updated port: 0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquired lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-changed-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.compute.manager [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Refreshing instance network info cache due to event network-changed-0c27b3e9-e1ed-4d3f-9d03-9539520f3174. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] Acquiring lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updating instance_info_cache with network_info: [{"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Releasing lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Instance network_info: |[{"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] Acquired lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:03 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Refreshing network info cache for port 0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:34:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updated VIF entry in instance network info cache for port 0c27b3e9-e1ed-4d3f-9d03-9539520f3174. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:34:04 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updating instance_info_cache with network_info: [{"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac0a981c-0add-40d1-9bf1-cced9f777fcb req-4a06f98a-e71d-4be8-b6dc-913de0571b6e service nova] Releasing lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:08 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:34:08 user nova-compute[75438]: INFO nova.compute.claims [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Claim successful on node user
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:34:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.policy [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ff6a04bdbde4baa8a9361a33fe822e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bce2ed85774546969a3751c866b287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:34:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Creating image(s)
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.247s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk 1073741824" returned: 0 in 0.051s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:09 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Successfully created port: 942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Cannot resize image /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Ensure instance console log exists: /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Successfully updated port: 942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.compute.manager [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing instance network info cache due to event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.network.neutron [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance network_info: |[{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:10 user nova-compute[75438]: DEBUG nova.network.neutron [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Start _get_guest_xml network_info=[{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:34:11 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:11 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291033211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291033211',id=43,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVlhSmcojpUvdS8JaRIrxYMsrdL5rdChxOu+fl7YSi5In3y/Xc93zCHTFADOktojsReZz3FsE1CfBi5LIfh4WIueQRgsFn0D92X0g//dDa/s/TKbVXLVOvZ55ZlfnMgg==',key_name='tempest-keypair-203736964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-9pflvk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=e830b0d8-5d6d-44c6-9439-f757c0a306fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'pci_devices' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:34:11 user nova-compute[75438]:   <uuid>e830b0d8-5d6d-44c6-9439-f757c0a306fe</uuid>
Nov 09 02:34:11 user nova-compute[75438]:   <name>instance-0000002b</name>
Nov 09 02:34:11 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:34:11 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:34:11 user nova-compute[75438]:   <metadata>
Nov 09 02:34:11 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:34:11 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:34:11 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1291033211</nova:name>
Nov 09 02:34:11 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:34:11</nova:creationTime>
Nov 09 02:34:11 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:34:11 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:34:11 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:34:11 user nova-compute[75438]:       <nova:owner>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:user uuid="2ff6a04bdbde4baa8a9361a33fe822e9">tempest-AttachVolumeShelveTestJSON-1323114484-project-member</nova:user>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:project uuid="04bce2ed85774546969a3751c866b287">tempest-AttachVolumeShelveTestJSON-1323114484</nova:project>
Nov 09 02:34:11 user nova-compute[75438]:       </nova:owner>
Nov 09 02:34:11 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:34:11 user nova-compute[75438]:       <nova:ports>
Nov 09 02:34:11 user nova-compute[75438]:         <nova:port uuid="942fdeac-74d0-497c-8f49-6a9e4e46b86d">
Nov 09 02:34:11 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 02:34:11 user nova-compute[75438]:         </nova:port>
Nov 09 02:34:11 user nova-compute[75438]:       </nova:ports>
Nov 09 02:34:11 user nova-compute[75438]:     </nova:instance>
Nov 09 02:34:11 user nova-compute[75438]:   </metadata>
Nov 09 02:34:11 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:34:11 user nova-compute[75438]:     <system>
Nov 09 02:34:11 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:34:11 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:34:11 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:34:11 user nova-compute[75438]:       <entry name="serial">e830b0d8-5d6d-44c6-9439-f757c0a306fe</entry>
Nov 09 02:34:11 user nova-compute[75438]:       <entry name="uuid">e830b0d8-5d6d-44c6-9439-f757c0a306fe</entry>
Nov 09 02:34:11 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:34:11 user nova-compute[75438]:     </system>
Nov 09 02:34:11 user nova-compute[75438]:   </sysinfo>
Nov 09 02:34:11 user nova-compute[75438]:   <os>
Nov 09 02:34:11 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:34:11 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:34:11 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:34:11 user nova-compute[75438]:   </os>
Nov 09 02:34:11 user nova-compute[75438]:   <features>
Nov 09 02:34:11 user nova-compute[75438]:     <acpi/>
Nov 09 02:34:11 user nova-compute[75438]:     <apic/>
Nov 09 02:34:11 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:34:11 user nova-compute[75438]:   </features>
Nov 09 02:34:11 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:34:11 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:34:11 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:34:11 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:34:11 user nova-compute[75438]:   </clock>
Nov 09 02:34:11 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:34:11 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:34:11 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:34:11 user nova-compute[75438]:   </cpu>
Nov 09 02:34:11 user nova-compute[75438]:   <devices>
Nov 09 02:34:11 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:34:11 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:34:11 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk"/>
Nov 09 02:34:11 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:34:11 user nova-compute[75438]:     </disk>
Nov 09 02:34:11 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:34:11 user nova-compute[75438]:       <mac address="fa:16:3e:31:af:cf"/>
Nov 09 02:34:11 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:34:11 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:34:11 user nova-compute[75438]:       <target dev="tap942fdeac-74"/>
Nov 09 02:34:11 user nova-compute[75438]:     </interface>
Nov 09 02:34:11 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:34:11 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/console.log" append="off"/>
Nov 09 02:34:11 user nova-compute[75438]:     </serial>
Nov 09 02:34:11 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:34:11 user nova-compute[75438]:     <video>
Nov 09 02:34:11 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:34:11 user nova-compute[75438]:     </video>
Nov 09 02:34:11 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:34:11 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:34:11 user nova-compute[75438]:     </rng>
Nov 09 02:34:11 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:34:11 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:34:11 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:34:11 user nova-compute[75438]:     </memballoon>
Nov 09 02:34:11 user nova-compute[75438]:   </devices>
Nov 09 02:34:11 user nova-compute[75438]: </domain>
Nov 09 02:34:11 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291033211',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291033211',id=43,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVlhSmcojpUvdS8JaRIrxYMsrdL5rdChxOu+fl7YSi5In3y/Xc93zCHTFADOktojsReZz3FsE1CfBi5LIfh4WIueQRgsFn0D92X0g//dDa/s/TKbVXLVOvZ55ZlfnMgg==',key_name='tempest-keypair-203736964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-9pflvk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=e830b0d8-5d6d-44c6-9439-f757c0a306fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG os_vif [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba57b008-ed5b-5663-b7fc-1b132abf83a5', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap942fdeac-74, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap942fdeac-74, col_values=(('qos', UUID('e70616aa-8569-4cb9-947b-115bb51e9764')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap942fdeac-74, col_values=(('external_ids', {'iface-id': '942fdeac-74d0-497c-8f49-6a9e4e46b86d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:af:cf', 'vm-uuid': 'e830b0d8-5d6d-44c6-9439-f757c0a306fe'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: INFO os_vif [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74')
Nov 09 02:34:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No VIF found with MAC fa:16:3e:31:af:cf, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updated VIF entry in instance network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-904b1e6d-195e-486f-bc39-9cb9f5279484 req-060bfc56-f86d-457d-9e8c-96f73b2f13ec service nova] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-19c944ad-53e3-4768-bf17-9b4b9c976853 req-2c4b58fe-c889-476e-b1b2-77a5f45404e9 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-19c944ad-53e3-4768-bf17-9b4b9c976853 req-2c4b58fe-c889-476e-b1b2-77a5f45404e9 service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-19c944ad-53e3-4768-bf17-9b4b9c976853 req-2c4b58fe-c889-476e-b1b2-77a5f45404e9 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-19c944ad-53e3-4768-bf17-9b4b9c976853 req-2c4b58fe-c889-476e-b1b2-77a5f45404e9 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-19c944ad-53e3-4768-bf17-9b4b9c976853 req-2c4b58fe-c889-476e-b1b2-77a5f45404e9 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:34:12 user nova-compute[75438]: WARNING nova.compute.manager [req-19c944ad-53e3-4768-bf17-9b4b9c976853 req-2c4b58fe-c889-476e-b1b2-77a5f45404e9 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state building and task_state spawning.
Nov 09 02:34:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:34:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance spawned successfully.
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-4466581e-bec7-47b5-80b2-6c124c94bbac req-66695bfa-0ab8-40d6-a61c-f0e239a2f220 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4466581e-bec7-47b5-80b2-6c124c94bbac req-66695bfa-0ab8-40d6-a61c-f0e239a2f220 service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4466581e-bec7-47b5-80b2-6c124c94bbac req-66695bfa-0ab8-40d6-a61c-f0e239a2f220 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4466581e-bec7-47b5-80b2-6c124c94bbac req-66695bfa-0ab8-40d6-a61c-f0e239a2f220 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-4466581e-bec7-47b5-80b2-6c124c94bbac req-66695bfa-0ab8-40d6-a61c-f0e239a2f220 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:34:14 user nova-compute[75438]: WARNING nova.compute.manager [req-4466581e-bec7-47b5-80b2-6c124c94bbac req-66695bfa-0ab8-40d6-a61c-f0e239a2f220 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state building and task_state spawning.
Nov 09 02:34:14 user nova-compute[75438]: INFO nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 09 02:34:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:34:14 user nova-compute[75438]: INFO nova.compute.manager [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Took 5.94 seconds to build instance.
Nov 09 02:34:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d1080ed4-de85-4f99-9ff7-e6f223971bde tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.042s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:34:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Creating image(s)
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Ensure instance console log exists: /opt/stack/data/nova/instances/a1a29106-1152-4451-98ac-a84a6539dff3/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Start _get_guest_xml network_info=[{"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'b43d2a76-7b76-4d87-ab8a-58ef0fb31f59', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1a29106-1152-4451-98ac-a84a6539dff3', 'attached_at': '', 'detached_at': '', 'volume_id': '6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'serial': '6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:34:34 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:34 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:34:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:34:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:34:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:34:35 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b0787e-b600-465c-bd3c-7fd5901f2a02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:34:35 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[093d2e04-d7e6-4119-b09a-34c28ffa9ab3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b] added
Nov 09 02:34:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[857542e2-b520-4d61-90cb-e3b209b2bc72]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4634848f-29ca-483e-85e3-88dc44cdfeb6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcTFHabB {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcTFHabB" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b6a9e-ab5a-4a03-8235-82d9b10cc384]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcTFHabB'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38e89d0-6037-4c35-8d37-33c0e1c7406d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e7aaa-e55a-4557-86cd-b265e106d00a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:34:35 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:34:35 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:34:35 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:34:35 user nova-compute[75438]: 
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[77136459-4697-4f6a-a861-dc853456df01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]
Nov 09 02:34:35 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.
Nov 09 02:34:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f71c9c-2c97-483b-8517-d3af36aae0c6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9c8419-b626-46f7-95d0-cb1907e7a9bf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:34:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:34:35 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9de006-f4d8-4132-ae4c-34e6fd35fdb4]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:34:35 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26638333365383231', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333365383231', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422761679',display_name='tempest-TestVolumeBootPattern-server-422761679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422761679',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-2541cnku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:34:02Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=a1a29106-1152-4451-98ac-a84a6539dff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.objects.instance [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'pci_devices' on Instance uuid a1a29106-1152-4451-98ac-a84a6539dff3 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:34:36 user nova-compute[75438]:   <uuid>a1a29106-1152-4451-98ac-a84a6539dff3</uuid>
Nov 09 02:34:36 user nova-compute[75438]:   <name>instance-0000002a</name>
Nov 09 02:34:36 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:34:36 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:34:36 user nova-compute[75438]:   <metadata>
Nov 09 02:34:36 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:34:36 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:34:36 user nova-compute[75438]:       <nova:name>tempest-TestVolumeBootPattern-server-422761679</nova:name>
Nov 09 02:34:36 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:34:34</nova:creationTime>
Nov 09 02:34:36 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:34:36 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:34:36 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:34:36 user nova-compute[75438]:       <nova:owner>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:user uuid="3b5297e15fd14f1395cb606e791c4202">tempest-TestVolumeBootPattern-1394927917-project-member</nova:user>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:project uuid="8f6c21c58de14dbda4534441cad48918">tempest-TestVolumeBootPattern-1394927917</nova:project>
Nov 09 02:34:36 user nova-compute[75438]:       </nova:owner>
Nov 09 02:34:36 user nova-compute[75438]:       <nova:ports>
Nov 09 02:34:36 user nova-compute[75438]:         <nova:port uuid="0c27b3e9-e1ed-4d3f-9d03-9539520f3174">
Nov 09 02:34:36 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 02:34:36 user nova-compute[75438]:         </nova:port>
Nov 09 02:34:36 user nova-compute[75438]:       </nova:ports>
Nov 09 02:34:36 user nova-compute[75438]:     </nova:instance>
Nov 09 02:34:36 user nova-compute[75438]:   </metadata>
Nov 09 02:34:36 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:34:36 user nova-compute[75438]:     <system>
Nov 09 02:34:36 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:34:36 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:34:36 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:34:36 user nova-compute[75438]:       <entry name="serial">a1a29106-1152-4451-98ac-a84a6539dff3</entry>
Nov 09 02:34:36 user nova-compute[75438]:       <entry name="uuid">a1a29106-1152-4451-98ac-a84a6539dff3</entry>
Nov 09 02:34:36 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:34:36 user nova-compute[75438]:     </system>
Nov 09 02:34:36 user nova-compute[75438]:   </sysinfo>
Nov 09 02:34:36 user nova-compute[75438]:   <os>
Nov 09 02:34:36 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:34:36 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:34:36 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:34:36 user nova-compute[75438]:   </os>
Nov 09 02:34:36 user nova-compute[75438]:   <features>
Nov 09 02:34:36 user nova-compute[75438]:     <acpi/>
Nov 09 02:34:36 user nova-compute[75438]:     <apic/>
Nov 09 02:34:36 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:34:36 user nova-compute[75438]:   </features>
Nov 09 02:34:36 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:34:36 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:34:36 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:34:36 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:34:36 user nova-compute[75438]:   </clock>
Nov 09 02:34:36 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:34:36 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:34:36 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:34:36 user nova-compute[75438]:   </cpu>
Nov 09 02:34:36 user nova-compute[75438]:   <devices>
Nov 09 02:34:36 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:34:36 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:34:36 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:34:36 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:34:36 user nova-compute[75438]:       <serial>6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b</serial>
Nov 09 02:34:36 user nova-compute[75438]:     </disk>
Nov 09 02:34:36 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:34:36 user nova-compute[75438]:       <mac address="fa:16:3e:27:67:16"/>
Nov 09 02:34:36 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:34:36 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:34:36 user nova-compute[75438]:       <target dev="tap0c27b3e9-e1"/>
Nov 09 02:34:36 user nova-compute[75438]:     </interface>
Nov 09 02:34:36 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:34:36 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/a1a29106-1152-4451-98ac-a84a6539dff3/console.log" append="off"/>
Nov 09 02:34:36 user nova-compute[75438]:     </serial>
Nov 09 02:34:36 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:34:36 user nova-compute[75438]:     <video>
Nov 09 02:34:36 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:34:36 user nova-compute[75438]:     </video>
Nov 09 02:34:36 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:34:36 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:34:36 user nova-compute[75438]:     </rng>
Nov 09 02:34:36 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:34:36 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:34:36 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:34:36 user nova-compute[75438]:     </memballoon>
Nov 09 02:34:36 user nova-compute[75438]:   </devices>
Nov 09 02:34:36 user nova-compute[75438]: </domain>
Nov 09 02:34:36 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422761679',display_name='tempest-TestVolumeBootPattern-server-422761679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422761679',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-2541cnku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:34:02Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=a1a29106-1152-4451-98ac-a84a6539dff3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG os_vif [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7556325a-ba28-515e-8743-2c6d2d6b7966', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c27b3e9-e1, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c27b3e9-e1, col_values=(('qos', UUID('6425021f-0931-48b5-ab15-b2b7941a6a4d')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c27b3e9-e1, col_values=(('external_ids', {'iface-id': '0c27b3e9-e1ed-4d3f-9d03-9539520f3174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:67:16', 'vm-uuid': 'a1a29106-1152-4451-98ac-a84a6539dff3'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:36 user nova-compute[75438]: INFO os_vif [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1')
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:34:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No VIF found with MAC fa:16:3e:27:67:16, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:34:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-1ad604af-83a6-4060-95e6-8f583c9ead18 req-29cf60f3-b809-4ec1-891e-a0814d077bbf service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1ad604af-83a6-4060-95e6-8f583c9ead18 req-29cf60f3-b809-4ec1-891e-a0814d077bbf service nova] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1ad604af-83a6-4060-95e6-8f583c9ead18 req-29cf60f3-b809-4ec1-891e-a0814d077bbf service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1ad604af-83a6-4060-95e6-8f583c9ead18 req-29cf60f3-b809-4ec1-891e-a0814d077bbf service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-1ad604af-83a6-4060-95e6-8f583c9ead18 req-29cf60f3-b809-4ec1-891e-a0814d077bbf service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] No waiting events found dispatching network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:34:38 user nova-compute[75438]: WARNING nova.compute.manager [req-1ad604af-83a6-4060-95e6-8f583c9ead18 req-29cf60f3-b809-4ec1-891e-a0814d077bbf service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received unexpected event network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 for instance with vm_state building and task_state spawning.
Nov 09 02:34:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Skipping network cache update for instance because it is Building. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:34:38 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:34:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:34:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Instance spawned successfully.
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-6d67a734-b6a0-45de-929e-b54433b29230 req-55628b71-fdcc-4ec7-b7de-8abea441b3b8 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6d67a734-b6a0-45de-929e-b54433b29230 req-55628b71-fdcc-4ec7-b7de-8abea441b3b8 service nova] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6d67a734-b6a0-45de-929e-b54433b29230 req-55628b71-fdcc-4ec7-b7de-8abea441b3b8 service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6d67a734-b6a0-45de-929e-b54433b29230 req-55628b71-fdcc-4ec7-b7de-8abea441b3b8 service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-6d67a734-b6a0-45de-929e-b54433b29230 req-55628b71-fdcc-4ec7-b7de-8abea441b3b8 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] No waiting events found dispatching network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:34:40 user nova-compute[75438]: WARNING nova.compute.manager [req-6d67a734-b6a0-45de-929e-b54433b29230 req-55628b71-fdcc-4ec7-b7de-8abea441b3b8 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received unexpected event network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 for instance with vm_state building and task_state spawning.
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:40 user nova-compute[75438]: INFO nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 09 02:34:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:34:40 user nova-compute[75438]: INFO nova.compute.manager [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Took 39.30 seconds to build instance.
Nov 09 02:34:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-49ebe9fb-3e97-4313-bf65-0a3243fd964b tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "a1a29106-1152-4451-98ac-a84a6539dff3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.391s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:34:42 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:43 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:43 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.003856658935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a1a29106-1152-4451-98ac-a84a6539dff3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e830b0d8-5d6d-44c6-9439-f757c0a306fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:34:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:44 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:34:44 user nova-compute[75438]: INFO nova.compute.claims [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Claim successful on node user
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.network.neutron [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:34:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.policy [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07c96c13758649518ea50354b3fe3eab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c03978fbf1934a1ebdefb24a585d59d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:34:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Creating image(s)
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "/opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "/opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "/opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.201s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk 1073741824" returned: 0 in 0.064s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:45 user nova-compute[75438]: DEBUG nova.network.neutron [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Successfully created port: cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Cannot resize image /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Ensure instance console log exists: /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Successfully updated port: cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "refresh_cache-8575a584-889f-4f8a-8a2c-57dd5aa02769" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquired lock "refresh_cache-8575a584-889f-4f8a-8a2c-57dd5aa02769" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-changed-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Refreshing instance network info cache due to event network-changed-cd66ac85-eb9d-4b96-8ebe-61897b9949a6. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] Acquiring lock "refresh_cache-8575a584-889f-4f8a-8a2c-57dd5aa02769" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Updating instance_info_cache with network_info: [{"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Releasing lock "refresh_cache-8575a584-889f-4f8a-8a2c-57dd5aa02769" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Instance network_info: |[{"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] Acquired lock "refresh_cache-8575a584-889f-4f8a-8a2c-57dd5aa02769" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.neutron [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Refreshing network info cache for port cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Start _get_guest_xml network_info=[{"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:34:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1261564445',display_name='tempest-VolumesActionsTest-instance-1261564445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1261564445',id=44,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c03978fbf1934a1ebdefb24a585d59d6',ramdisk_id='',reservation_id='r-ktec9lb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-146170135',owner_user_name='tempest-VolumesActionsTest-146170135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:34:45Z,user_data=None,user_id='07c96c13758649518ea50354b3fe3eab',uuid=8575a584-889f-4f8a-8a2c-57dd5aa02769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converting VIF {"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.objects.instance [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lazy-loading 'pci_devices' on Instance uuid 8575a584-889f-4f8a-8a2c-57dd5aa02769 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:34:46 user nova-compute[75438]:   <uuid>8575a584-889f-4f8a-8a2c-57dd5aa02769</uuid>
Nov 09 02:34:46 user nova-compute[75438]:   <name>instance-0000002c</name>
Nov 09 02:34:46 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:34:46 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:34:46 user nova-compute[75438]:   <metadata>
Nov 09 02:34:46 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:34:46 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:34:46 user nova-compute[75438]:       <nova:name>tempest-VolumesActionsTest-instance-1261564445</nova:name>
Nov 09 02:34:46 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:34:46</nova:creationTime>
Nov 09 02:34:46 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:34:46 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:34:46 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:34:46 user nova-compute[75438]:       <nova:owner>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:user uuid="07c96c13758649518ea50354b3fe3eab">tempest-VolumesActionsTest-146170135-project-member</nova:user>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:project uuid="c03978fbf1934a1ebdefb24a585d59d6">tempest-VolumesActionsTest-146170135</nova:project>
Nov 09 02:34:46 user nova-compute[75438]:       </nova:owner>
Nov 09 02:34:46 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:34:46 user nova-compute[75438]:       <nova:ports>
Nov 09 02:34:46 user nova-compute[75438]:         <nova:port uuid="cd66ac85-eb9d-4b96-8ebe-61897b9949a6">
Nov 09 02:34:46 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 09 02:34:46 user nova-compute[75438]:         </nova:port>
Nov 09 02:34:46 user nova-compute[75438]:       </nova:ports>
Nov 09 02:34:46 user nova-compute[75438]:     </nova:instance>
Nov 09 02:34:46 user nova-compute[75438]:   </metadata>
Nov 09 02:34:46 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:34:46 user nova-compute[75438]:     <system>
Nov 09 02:34:46 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:34:46 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:34:46 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:34:46 user nova-compute[75438]:       <entry name="serial">8575a584-889f-4f8a-8a2c-57dd5aa02769</entry>
Nov 09 02:34:46 user nova-compute[75438]:       <entry name="uuid">8575a584-889f-4f8a-8a2c-57dd5aa02769</entry>
Nov 09 02:34:46 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:34:46 user nova-compute[75438]:     </system>
Nov 09 02:34:46 user nova-compute[75438]:   </sysinfo>
Nov 09 02:34:46 user nova-compute[75438]:   <os>
Nov 09 02:34:46 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:34:46 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:34:46 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:34:46 user nova-compute[75438]:   </os>
Nov 09 02:34:46 user nova-compute[75438]:   <features>
Nov 09 02:34:46 user nova-compute[75438]:     <acpi/>
Nov 09 02:34:46 user nova-compute[75438]:     <apic/>
Nov 09 02:34:46 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:34:46 user nova-compute[75438]:   </features>
Nov 09 02:34:46 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:34:46 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:34:46 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:34:46 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:34:46 user nova-compute[75438]:   </clock>
Nov 09 02:34:46 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:34:46 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:34:46 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:34:46 user nova-compute[75438]:   </cpu>
Nov 09 02:34:46 user nova-compute[75438]:   <devices>
Nov 09 02:34:46 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:34:46 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:34:46 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk"/>
Nov 09 02:34:46 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:34:46 user nova-compute[75438]:     </disk>
Nov 09 02:34:46 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:34:46 user nova-compute[75438]:       <mac address="fa:16:3e:f6:c0:41"/>
Nov 09 02:34:46 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:34:46 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:34:46 user nova-compute[75438]:       <target dev="tapcd66ac85-eb"/>
Nov 09 02:34:46 user nova-compute[75438]:     </interface>
Nov 09 02:34:46 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:34:46 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/console.log" append="off"/>
Nov 09 02:34:46 user nova-compute[75438]:     </serial>
Nov 09 02:34:46 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:34:46 user nova-compute[75438]:     <video>
Nov 09 02:34:46 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:34:46 user nova-compute[75438]:     </video>
Nov 09 02:34:46 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:34:46 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:34:46 user nova-compute[75438]:     </rng>
Nov 09 02:34:46 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:34:46 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:34:46 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:34:46 user nova-compute[75438]:     </memballoon>
Nov 09 02:34:46 user nova-compute[75438]:   </devices>
Nov 09 02:34:46 user nova-compute[75438]: </domain>
Nov 09 02:34:46 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1261564445',display_name='tempest-VolumesActionsTest-instance-1261564445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1261564445',id=44,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c03978fbf1934a1ebdefb24a585d59d6',ramdisk_id='',reservation_id='r-ktec9lb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-146170135',owner_user_name='tempest-VolumesActionsTest-146170135-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:34:45Z,user_data=None,user_id='07c96c13758649518ea50354b3fe3eab',uuid=8575a584-889f-4f8a-8a2c-57dd5aa02769,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converting VIF {"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG os_vif [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0867c75-9b84-5235-9bb7-c097a37618da', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd66ac85-eb, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd66ac85-eb, col_values=(('qos', UUID('a9276751-fde6-4449-9eaf-a29caf0e9326')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd66ac85-eb, col_values=(('external_ids', {'iface-id': 'cd66ac85-eb9d-4b96-8ebe-61897b9949a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:c0:41', 'vm-uuid': '8575a584-889f-4f8a-8a2c-57dd5aa02769'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:34:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:47 user nova-compute[75438]: INFO os_vif [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb')
Nov 09 02:34:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:34:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] No VIF found with MAC fa:16:3e:f6:c0:41, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:34:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Updated VIF entry in instance network info cache for port cd66ac85-eb9d-4b96-8ebe-61897b9949a6. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:34:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Updating instance_info_cache with network_info: [{"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:34:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-550b92ff-791b-40a1-9288-0e97fe2c85b9 req-5af06038-799a-43e9-b84a-6c4d7b3865b8 service nova] Releasing lock "refresh_cache-8575a584-889f-4f8a-8a2c-57dd5aa02769" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-a99faf19-27d6-4201-b3b3-be470867102e req-230a40c6-461d-40c5-af4c-7e6b94442d59 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a99faf19-27d6-4201-b3b3-be470867102e req-230a40c6-461d-40c5-af4c-7e6b94442d59 service nova] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a99faf19-27d6-4201-b3b3-be470867102e req-230a40c6-461d-40c5-af4c-7e6b94442d59 service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a99faf19-27d6-4201-b3b3-be470867102e req-230a40c6-461d-40c5-af4c-7e6b94442d59 service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-a99faf19-27d6-4201-b3b3-be470867102e req-230a40c6-461d-40c5-af4c-7e6b94442d59 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] No waiting events found dispatching network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:34:48 user nova-compute[75438]: WARNING nova.compute.manager [req-a99faf19-27d6-4201-b3b3-be470867102e req-230a40c6-461d-40c5-af4c-7e6b94442d59 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received unexpected event network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 for instance with vm_state building and task_state spawning.
Nov 09 02:34:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:34:50 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Instance spawned successfully.
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:34:50 user nova-compute[75438]: INFO nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc92d158-f451-43f6-b5a1-27c1b7b52410 req-69f2e860-9cac-4590-a1c3-6072e238823b service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc92d158-f451-43f6-b5a1-27c1b7b52410 req-69f2e860-9cac-4590-a1c3-6072e238823b service nova] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc92d158-f451-43f6-b5a1-27c1b7b52410 req-69f2e860-9cac-4590-a1c3-6072e238823b service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc92d158-f451-43f6-b5a1-27c1b7b52410 req-69f2e860-9cac-4590-a1c3-6072e238823b service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc92d158-f451-43f6-b5a1-27c1b7b52410 req-69f2e860-9cac-4590-a1c3-6072e238823b service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] No waiting events found dispatching network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:34:50 user nova-compute[75438]: WARNING nova.compute.manager [req-dc92d158-f451-43f6-b5a1-27c1b7b52410 req-69f2e860-9cac-4590-a1c3-6072e238823b service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received unexpected event network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 for instance with vm_state building and task_state spawning.
Nov 09 02:34:50 user nova-compute[75438]: INFO nova.compute.manager [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Took 6.18 seconds to build instance.
Nov 09 02:34:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-32979a50-bedc-4863-bb6c-b294e9d1950c tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.299s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:34:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:34:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:34:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:35:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:35:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid a1a29106-1152-4451-98ac-a84a6539dff3 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:35:40 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updating instance_info_cache with network_info: [{"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:35:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:35:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:35:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:35:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:43 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:35:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:45 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:35:45 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=24.96536636352539GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance a1a29106-1152-4451-98ac-a84a6539dff3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e830b0d8-5d6d-44c6-9439-f757c0a306fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 8575a584-889f-4f8a-8a2c-57dd5aa02769 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:35:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:35:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:35:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-changed-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Refreshing instance network info cache due to event network-changed-0c27b3e9-e1ed-4d3f-9d03-9539520f3174. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] Acquiring lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] Acquired lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:35:52 user nova-compute[75438]: DEBUG nova.network.neutron [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Refreshing network info cache for port 0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "a1a29106-1152-4451-98ac-a84a6539dff3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:53 user nova-compute[75438]: INFO nova.compute.manager [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Terminating instance
Nov 09 02:35:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG nova.network.neutron [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updated VIF entry in instance network info cache for port 0c27b3e9-e1ed-4d3f-9d03-9539520f3174. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG nova.network.neutron [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updating instance_info_cache with network_info: [{"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-819afc5a-2c3d-4f9e-a710-d22cc6c07a88 req-663e122a-cc19-4e33-9a85-013974af6dd0 service nova] Releasing lock "refresh_cache-a1a29106-1152-4451-98ac-a84a6539dff3" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-39944a14-703c-4405-ae73-106798d984ca req-f79adab1-bcc9-4376-b073-7b4b5381791e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-vif-unplugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-39944a14-703c-4405-ae73-106798d984ca req-f79adab1-bcc9-4376-b073-7b4b5381791e service nova] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-39944a14-703c-4405-ae73-106798d984ca req-f79adab1-bcc9-4376-b073-7b4b5381791e service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-39944a14-703c-4405-ae73-106798d984ca req-f79adab1-bcc9-4376-b073-7b4b5381791e service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-39944a14-703c-4405-ae73-106798d984ca req-f79adab1-bcc9-4376-b073-7b4b5381791e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] No waiting events found dispatching network-vif-unplugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:35:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-39944a14-703c-4405-ae73-106798d984ca req-f79adab1-bcc9-4376-b073-7b4b5381791e service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-vif-unplugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:35:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Instance destroyed successfully.
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'resources' on Instance uuid a1a29106-1152-4451-98ac-a84a6539dff3 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-422761679',display_name='tempest-TestVolumeBootPattern-server-422761679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-422761679',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:34:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-2541cnku',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:34:40Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=a1a29106-1152-4451-98ac-a84a6539dff3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "address": "fa:16:3e:27:67:16", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c27b3e9-e1", "ovs_interfaceid": "0c27b3e9-e1ed-4d3f-9d03-9539520f3174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_vif [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c27b3e9-e1, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6425021f-0931-48b5-ab15-b2b7941a6a4d) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:54 user nova-compute[75438]: INFO os_vif [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:67:16,bridge_name='br-int',has_traffic_filtering=True,id=0c27b3e9-e1ed-4d3f-9d03-9539520f3174,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c27b3e9-e1')
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:35:54 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0933dc2f-e711-4acf-9748-0b995167c8f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:35:54 user nova-compute[75438]: No targets found.
Nov 09 02:35:54 user nova-compute[75438]: iSNS:
Nov 09 02:35:54 user nova-compute[75438]: No targets found.
Nov 09 02:35:54 user nova-compute[75438]: STATIC:
Nov 09 02:35:54 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b
Nov 09 02:35:54 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:35:54 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:35:54 user nova-compute[75438]: FIRMWARE:
Nov 09 02:35:54 user nova-compute[75438]: No targets found.
Nov 09 02:35:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:35:54 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:35:54 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7521f5-a405-424e-a36d-4553a0becb67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c748a92-3003-4967-9aed-a9e39d90def4]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:35:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:35:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba245ba290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc1a100-daf6-48b2-bd56-695e81de07e3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e41df-c4cc-4aaa-b6a7-e407b843210f]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6711a60f-6379-4116-972b-7fc38b0a84dc]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c46e8b5-21a9-4cea-bffd-ebb6a78bb1fa]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb80e87-0417-422c-bfb8-80ceccc2586e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c853b7-b154-4adc-a1d4-1447ce0e5bb4]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]
Nov 09 02:35:54 user nova-compute[75438]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.
Nov 09 02:35:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4815fe63-42eb-40de-bc2c-2c2672538914]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== disconnect_volume: return (291ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:35:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Deleting instance files /opt/stack/data/nova/instances/a1a29106-1152-4451-98ac-a84a6539dff3_del
Nov 09 02:35:54 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Deletion of /opt/stack/data/nova/instances/a1a29106-1152-4451-98ac-a84a6539dff3_del complete
Nov 09 02:35:54 user nova-compute[75438]: INFO nova.compute.manager [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:35:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:55 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:35:55 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Took 0.88 seconds to deallocate network for instance.
Nov 09 02:35:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:35:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] Acquiring lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] Lock "a1a29106-1152-4451-98ac-a84a6539dff3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] No waiting events found dispatching network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:35:55 user nova-compute[75438]: WARNING nova.compute.manager [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received unexpected event network-vif-plugged-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 for instance with vm_state active and task_state deleting.
Nov 09 02:35:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-ad000cbb-54e4-4287-a7a7-25ababa89012 req-78fe4731-7b48-45ef-b58d-99a63f5eceb4 service nova] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Received event network-vif-deleted-0c27b3e9-e1ed-4d3f-9d03-9539520f3174 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:35:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:56 user nova-compute[75438]: INFO nova.compute.manager [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: a1a29106-1152-4451-98ac-a84a6539dff3] Took 1.01 seconds to detach 1 volumes for instance.
Nov 09 02:35:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:35:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:35:56 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:35:56 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:35:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:56 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Deleted allocations for instance a1a29106-1152-4451-98ac-a84a6539dff3
Nov 09 02:35:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b4e70383-576c-41b4-ba95-1df57f8b31ac tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "a1a29106-1152-4451-98ac-a84a6539dff3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.511s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:35:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:35:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:35:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:35:59 user nova-compute[75438]: DEBUG nova.compute.manager [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing instance network info cache due to event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:35:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:35:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:35:59 user nova-compute[75438]: DEBUG nova.network.neutron [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:36:00 user nova-compute[75438]: DEBUG nova.network.neutron [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updated VIF entry in instance network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:36:00 user nova-compute[75438]: DEBUG nova.network.neutron [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7bc2bb8b-e118-4804-88ae-cb1cc6a2cdc6 req-5f944e0c-9309-46e2-9915-676d554890e3 service nova] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:36:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:06 user nova-compute[75438]: INFO nova.compute.manager [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Shelving
Nov 09 02:36:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-29459e2e-de61-485e-9f8e-f58d04e99d83 req-7937744c-c6bd-4415-8652-ede8469115dc service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-unplugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-29459e2e-de61-485e-9f8e-f58d04e99d83 req-7937744c-c6bd-4415-8652-ede8469115dc service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-29459e2e-de61-485e-9f8e-f58d04e99d83 req-7937744c-c6bd-4415-8652-ede8469115dc service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-29459e2e-de61-485e-9f8e-f58d04e99d83 req-7937744c-c6bd-4415-8652-ede8469115dc service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-29459e2e-de61-485e-9f8e-f58d04e99d83 req-7937744c-c6bd-4415-8652-ede8469115dc service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-unplugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:36:07 user nova-compute[75438]: WARNING nova.compute.manager [req-29459e2e-de61-485e-9f8e-f58d04e99d83 req-7937744c-c6bd-4415-8652-ede8469115dc service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-unplugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state active and task_state shelving.
Nov 09 02:36:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance destroyed successfully.
Nov 09 02:36:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Beginning cold snapshot process
Nov 09 02:36:07 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:36:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk /opt/stack/data/nova/instances/snapshots/tmpm6yu7yro/b29a5ce091fe423bbd188ea3af64622f {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:36:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk /opt/stack/data/nova/instances/snapshots/tmpm6yu7yro/b29a5ce091fe423bbd188ea3af64622f" returned: 0 in 0.711s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:36:08 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Snapshot extracted, beginning image upload
Nov 09 02:36:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-6882da6d-0ee0-4d7c-8c71-516ad0c32231 req-1358f0d9-8a9d-4b05-af52-b8933135ce32 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6882da6d-0ee0-4d7c-8c71-516ad0c32231 req-1358f0d9-8a9d-4b05-af52-b8933135ce32 service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6882da6d-0ee0-4d7c-8c71-516ad0c32231 req-1358f0d9-8a9d-4b05-af52-b8933135ce32 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6882da6d-0ee0-4d7c-8c71-516ad0c32231 req-1358f0d9-8a9d-4b05-af52-b8933135ce32 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-6882da6d-0ee0-4d7c-8c71-516ad0c32231 req-1358f0d9-8a9d-4b05-af52-b8933135ce32 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:36:09 user nova-compute[75438]: WARNING nova.compute.manager [req-6882da6d-0ee0-4d7c-8c71-516ad0c32231 req-1358f0d9-8a9d-4b05-af52-b8933135ce32 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state active and task_state shelving_image_uploading.
Nov 09 02:36:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Snapshot image upload complete
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:36:11 user nova-compute[75438]: INFO nova.compute.manager [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Shelve offloading
Nov 09 02:36:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance destroyed successfully.
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance destroyed successfully.
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.objects.instance [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'resources' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291033211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291033211',id=43,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVlhSmcojpUvdS8JaRIrxYMsrdL5rdChxOu+fl7YSi5In3y/Xc93zCHTFADOktojsReZz3FsE1CfBi5LIfh4WIueQRgsFn0D92X0g//dDa/s/TKbVXLVOvZ55ZlfnMgg==',key_name='tempest-keypair-203736964',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-9pflvk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member',shelved_at='2023-11-09T02:36:11.059271',shelved_host='user',shelved_image_id='6bd1d3ab-0721-40b0-b2e2-6ef867c76313'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=e830b0d8-5d6d-44c6-9439-f757c0a306fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG os_vif [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap942fdeac-74, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.compute.manager [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing instance network info cache due to event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG nova.network.neutron [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:36:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e70616aa-8569-4cb9-947b-115bb51e9764) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:36:12 user nova-compute[75438]: INFO os_vif [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74')
Nov 09 02:36:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Deleting instance files /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe_del
Nov 09 02:36:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Deletion of /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe_del complete
Nov 09 02:36:12 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Deleted allocations for instance e830b0d8-5d6d-44c6-9439-f757c0a306fe
Nov 09 02:36:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG nova.objects.instance [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'numa_topology' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG nova.objects.base [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<e830b0d8-5d6d-44c6-9439-f757c0a306fe> lazy-loaded attributes: resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG nova.network.neutron [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updated VIF entry in instance network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG nova.network.neutron [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap942fdeac-74", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-64595b52-ed51-4133-8027-f4b95af09058 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.420s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5cca9c86-4e0d-4f9f-9fe7-abfa289de6d8 req-1bb4bea7-59f8-4608-8814-4f052725c5d1 service nova] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:36:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:35 user nova-compute[75438]: INFO nova.compute.manager [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Terminating instance
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-54ade5f4-f7a1-4a29-a59e-2799f41006a6 req-5aa273d6-5702-4721-b362-85b68ed0f921 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-vif-unplugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-54ade5f4-f7a1-4a29-a59e-2799f41006a6 req-5aa273d6-5702-4721-b362-85b68ed0f921 service nova] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-54ade5f4-f7a1-4a29-a59e-2799f41006a6 req-5aa273d6-5702-4721-b362-85b68ed0f921 service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-54ade5f4-f7a1-4a29-a59e-2799f41006a6 req-5aa273d6-5702-4721-b362-85b68ed0f921 service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-54ade5f4-f7a1-4a29-a59e-2799f41006a6 req-5aa273d6-5702-4721-b362-85b68ed0f921 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] No waiting events found dispatching network-vif-unplugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-54ade5f4-f7a1-4a29-a59e-2799f41006a6 req-5aa273d6-5702-4721-b362-85b68ed0f921 service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-vif-unplugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:36:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Instance destroyed successfully.
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lazy-loading 'resources' on Instance uuid 8575a584-889f-4f8a-8a2c-57dd5aa02769 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:34:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1261564445',display_name='tempest-VolumesActionsTest-instance-1261564445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1261564445',id=44,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c03978fbf1934a1ebdefb24a585d59d6',ramdisk_id='',reservation_id='r-ktec9lb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-146170135',owner_user_name='tempest-VolumesActionsTest-146170135-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:34:51Z,user_data=None,user_id='07c96c13758649518ea50354b3fe3eab',uuid=8575a584-889f-4f8a-8a2c-57dd5aa02769,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converting VIF {"id": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "address": "fa:16:3e:f6:c0:41", "network": {"id": "c5860214-b36e-4627-b150-a721b4a91e38", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1402743370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c03978fbf1934a1ebdefb24a585d59d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd66ac85-eb", "ovs_interfaceid": "cd66ac85-eb9d-4b96-8ebe-61897b9949a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG os_vif [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd66ac85-eb, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9276751-fde6-4449-9eaf-a29caf0e9326) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:36:35 user nova-compute[75438]: INFO os_vif [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:c0:41,bridge_name='br-int',has_traffic_filtering=True,id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6,network=Network(c5860214-b36e-4627-b150-a721b4a91e38),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd66ac85-eb')
Nov 09 02:36:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Deleting instance files /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769_del
Nov 09 02:36:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Deletion of /opt/stack/data/nova/instances/8575a584-889f-4f8a-8a2c-57dd5aa02769_del complete
Nov 09 02:36:36 user nova-compute[75438]: INFO nova.compute.manager [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 09 02:36:36 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:36 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Took 0.47 seconds to deallocate network for instance.
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-c0cc2a46-510b-405b-8c15-de32309f7482 req-bbe59a25-8cde-45c4-9749-d0fe579289db service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-vif-deleted-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:36 user nova-compute[75438]: INFO nova.compute.manager [req-c0cc2a46-510b-405b-8c15-de32309f7482 req-bbe59a25-8cde-45c4-9749-d0fe579289db service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Neutron deleted interface cd66ac85-eb9d-4b96-8ebe-61897b9949a6; detaching it from the instance and deleting it from the info cache
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-c0cc2a46-510b-405b-8c15-de32309f7482 req-bbe59a25-8cde-45c4-9749-d0fe579289db service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-c0cc2a46-510b-405b-8c15-de32309f7482 req-bbe59a25-8cde-45c4-9749-d0fe579289db service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Detach interface failed, port_id=cd66ac85-eb9d-4b96-8ebe-61897b9949a6, reason: Instance 8575a584-889f-4f8a-8a2c-57dd5aa02769 could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:36:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:36 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Deleted allocations for instance 8575a584-889f-4f8a-8a2c-57dd5aa02769
Nov 09 02:36:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f84590d0-d9ed-4e24-af8e-8eb9152aa757 tempest-VolumesActionsTest-146170135 tempest-VolumesActionsTest-146170135-project-member] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.432s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-4d909f24-b7ad-4395-a8e0-11b1d5c97285 req-a29de0eb-6c17-4f66-a823-a8a631726e8c service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received event network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4d909f24-b7ad-4395-a8e0-11b1d5c97285 req-a29de0eb-6c17-4f66-a823-a8a631726e8c service nova] Acquiring lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4d909f24-b7ad-4395-a8e0-11b1d5c97285 req-a29de0eb-6c17-4f66-a823-a8a631726e8c service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4d909f24-b7ad-4395-a8e0-11b1d5c97285 req-a29de0eb-6c17-4f66-a823-a8a631726e8c service nova] Lock "8575a584-889f-4f8a-8a2c-57dd5aa02769-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-4d909f24-b7ad-4395-a8e0-11b1d5c97285 req-a29de0eb-6c17-4f66-a823-a8a631726e8c service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] No waiting events found dispatching network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:36:37 user nova-compute[75438]: WARNING nova.compute.manager [req-4d909f24-b7ad-4395-a8e0-11b1d5c97285 req-a29de0eb-6c17-4f66-a823-a8a631726e8c service nova] [instance: 8575a584-889f-4f8a-8a2c-57dd5aa02769] Received unexpected event network-vif-plugged-cd66ac85-eb9d-4b96-8ebe-61897b9949a6 for instance with vm_state deleted and task_state None.
Nov 09 02:36:39 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:36:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 09 02:36:39 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:36:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:36:45 user nova-compute[75438]: INFO nova.compute.claims [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Claim successful on node user
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:36:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.policy [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5297e15fd14f1395cb606e791c4202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c21c58de14dbda4534441cad48918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:36:45 user nova-compute[75438]: INFO nova.virt.block_device [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Booting with volume 6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b at /dev/vda
Nov 09 02:36:45 user nova-compute[75438]: DEBUG os_brick.utils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fd6663-71fe-43fa-97e5-e72add10b591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb00836-88f5-435c-a527-b2c33f855cac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16d7fe-c539-4844-8a1e-1be229ff369b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c37c13-1395-4bdf-b7d6-d0dd1418865a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:36:45 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:36:45 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3034e0-1c56-4d54-82cd-cb7896e72914]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG os_brick.utils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:36:45 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating existing volume attachment record: 30854b5a-84a2-4984-bdc2-74dab1cd2472 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Successfully created port: 65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:36:46 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=24.969390869140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Successfully updated port: 65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-changed-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.compute.manager [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Refreshing instance network info cache due to event network-changed-65d244fa-d424-42d3-9531-810994705c9e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:36:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Instance network_info: |[{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Refreshing network info cache for port 65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updated VIF entry in instance network info cache for port 65d244fa-d424-42d3-9531-810994705c9e. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG nova.network.neutron [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:36:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cd46fcc8-6126-417a-8c6f-56fa8d56d5be req-3eea54fd-72f6-43b0-be89-7308feb648f4 service nova] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:36:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:36:56 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:36:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:37:09 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Creating image(s)
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Ensure instance console log exists: /opt/stack/data/nova/instances/d439e4ed-0ea3-49fc-82bd-a3ccadb8101a/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Start _get_guest_xml network_info=[{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '30854b5a-84a2-4984-bdc2-74dab1cd2472', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd439e4ed-0ea3-49fc-82bd-a3ccadb8101a', 'attached_at': '', 'detached_at': '', 'volume_id': '6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'serial': '6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:37:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:37:09 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:37:09 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:37:09 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:37:09 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d324a7c-63e6-45ce-ba03-56ae7a271322]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:37:09 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fd74b4-d364-4120-90a6-d852dafa4be9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b] added
Nov 09 02:37:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f581f-20b6-4ac6-9b79-32653e779f2a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ed530-e0b5-4ca8-9db4-325c5aec29c3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcTFHabB {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZcTFHabB" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c1031a-12d4-4490-ad52-5d310579af35]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZcTFHabB'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a674e333-62f2-4005-9e8b-e71880288831]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db52ae-b733-4956-a95e-22df3eb609c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:37:09 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:37:09 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:37:09 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:37:09 user nova-compute[75438]: 
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e09f5d-7703-4e9d-a888-074f5f854518]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]
Nov 09 02:37:09 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.
Nov 09 02:37:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e71e29-5be4-4edf-8f52-1a1097fa06b3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d829dc0-b948-4786-baab-8e94cb0773bc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:37:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:37:09 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a36d14-65f1-4bec-bd35-f9c71e074741]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:37:09 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26638333365383231', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333365383231', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476224391',display_name='tempest-TestVolumeBootPattern-server-476224391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476224391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-8i4b4qlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:36:46Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=d439e4ed-0ea3-49fc-82bd-a3ccadb8101a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'pci_devices' on Instance uuid d439e4ed-0ea3-49fc-82bd-a3ccadb8101a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:37:10 user nova-compute[75438]:   <uuid>d439e4ed-0ea3-49fc-82bd-a3ccadb8101a</uuid>
Nov 09 02:37:10 user nova-compute[75438]:   <name>instance-0000002d</name>
Nov 09 02:37:10 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:37:10 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:37:10 user nova-compute[75438]:   <metadata>
Nov 09 02:37:10 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:37:10 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:37:10 user nova-compute[75438]:       <nova:name>tempest-TestVolumeBootPattern-server-476224391</nova:name>
Nov 09 02:37:10 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:37:09</nova:creationTime>
Nov 09 02:37:10 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:37:10 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:37:10 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:37:10 user nova-compute[75438]:       <nova:owner>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:user uuid="3b5297e15fd14f1395cb606e791c4202">tempest-TestVolumeBootPattern-1394927917-project-member</nova:user>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:project uuid="8f6c21c58de14dbda4534441cad48918">tempest-TestVolumeBootPattern-1394927917</nova:project>
Nov 09 02:37:10 user nova-compute[75438]:       </nova:owner>
Nov 09 02:37:10 user nova-compute[75438]:       <nova:ports>
Nov 09 02:37:10 user nova-compute[75438]:         <nova:port uuid="65d244fa-d424-42d3-9531-810994705c9e">
Nov 09 02:37:10 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 09 02:37:10 user nova-compute[75438]:         </nova:port>
Nov 09 02:37:10 user nova-compute[75438]:       </nova:ports>
Nov 09 02:37:10 user nova-compute[75438]:     </nova:instance>
Nov 09 02:37:10 user nova-compute[75438]:   </metadata>
Nov 09 02:37:10 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:37:10 user nova-compute[75438]:     <system>
Nov 09 02:37:10 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:37:10 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:37:10 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:37:10 user nova-compute[75438]:       <entry name="serial">d439e4ed-0ea3-49fc-82bd-a3ccadb8101a</entry>
Nov 09 02:37:10 user nova-compute[75438]:       <entry name="uuid">d439e4ed-0ea3-49fc-82bd-a3ccadb8101a</entry>
Nov 09 02:37:10 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:37:10 user nova-compute[75438]:     </system>
Nov 09 02:37:10 user nova-compute[75438]:   </sysinfo>
Nov 09 02:37:10 user nova-compute[75438]:   <os>
Nov 09 02:37:10 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:37:10 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:37:10 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:37:10 user nova-compute[75438]:   </os>
Nov 09 02:37:10 user nova-compute[75438]:   <features>
Nov 09 02:37:10 user nova-compute[75438]:     <acpi/>
Nov 09 02:37:10 user nova-compute[75438]:     <apic/>
Nov 09 02:37:10 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:37:10 user nova-compute[75438]:   </features>
Nov 09 02:37:10 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:37:10 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:37:10 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:37:10 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:37:10 user nova-compute[75438]:   </clock>
Nov 09 02:37:10 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:37:10 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:37:10 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:37:10 user nova-compute[75438]:   </cpu>
Nov 09 02:37:10 user nova-compute[75438]:   <devices>
Nov 09 02:37:10 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:37:10 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:37:10 user nova-compute[75438]:       <source dev="/dev/sdb"/>
Nov 09 02:37:10 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:37:10 user nova-compute[75438]:       <serial>6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b</serial>
Nov 09 02:37:10 user nova-compute[75438]:     </disk>
Nov 09 02:37:10 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:37:10 user nova-compute[75438]:       <mac address="fa:16:3e:d9:01:7a"/>
Nov 09 02:37:10 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:37:10 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:37:10 user nova-compute[75438]:       <target dev="tap65d244fa-d4"/>
Nov 09 02:37:10 user nova-compute[75438]:     </interface>
Nov 09 02:37:10 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:37:10 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/d439e4ed-0ea3-49fc-82bd-a3ccadb8101a/console.log" append="off"/>
Nov 09 02:37:10 user nova-compute[75438]:     </serial>
Nov 09 02:37:10 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:37:10 user nova-compute[75438]:     <video>
Nov 09 02:37:10 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:37:10 user nova-compute[75438]:     </video>
Nov 09 02:37:10 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:37:10 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:37:10 user nova-compute[75438]:     </rng>
Nov 09 02:37:10 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:37:10 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:37:10 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:37:10 user nova-compute[75438]:     </memballoon>
Nov 09 02:37:10 user nova-compute[75438]:   </devices>
Nov 09 02:37:10 user nova-compute[75438]: </domain>
Nov 09 02:37:10 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476224391',display_name='tempest-TestVolumeBootPattern-server-476224391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476224391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-8i4b4qlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:36:46Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=d439e4ed-0ea3-49fc-82bd-a3ccadb8101a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG os_vif [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ab8f394-0c58-5070-9892-6b7b22f5f45d', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d244fa-d4, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65d244fa-d4, col_values=(('qos', UUID('e1b7615e-0da2-45b2-8cff-4eaa93787f82')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65d244fa-d4, col_values=(('external_ids', {'iface-id': '65d244fa-d424-42d3-9531-810994705c9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:01:7a', 'vm-uuid': 'd439e4ed-0ea3-49fc-82bd-a3ccadb8101a'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:10 user nova-compute[75438]: INFO os_vif [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4')
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:37:10 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No VIF found with MAC fa:16:3e:d9:01:7a, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-4aac5f3d-0459-4f15-9b13-2e2d33c84cd9 req-fd3adaf2-2c50-4996-a321-19c359a684c3 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4aac5f3d-0459-4f15-9b13-2e2d33c84cd9 req-fd3adaf2-2c50-4996-a321-19c359a684c3 service nova] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4aac5f3d-0459-4f15-9b13-2e2d33c84cd9 req-fd3adaf2-2c50-4996-a321-19c359a684c3 service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4aac5f3d-0459-4f15-9b13-2e2d33c84cd9 req-fd3adaf2-2c50-4996-a321-19c359a684c3 service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG nova.compute.manager [req-4aac5f3d-0459-4f15-9b13-2e2d33c84cd9 req-fd3adaf2-2c50-4996-a321-19c359a684c3 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] No waiting events found dispatching network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:37:12 user nova-compute[75438]: WARNING nova.compute.manager [req-4aac5f3d-0459-4f15-9b13-2e2d33c84cd9 req-fd3adaf2-2c50-4996-a321-19c359a684c3 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received unexpected event network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e for instance with vm_state building and task_state spawning.
Nov 09 02:37:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:37:14 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Instance spawned successfully.
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-3e1915dd-e53d-4f5e-9e8c-0f3275cfe026 req-33ed6194-5e83-4376-92f3-ba3c8a791b48 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3e1915dd-e53d-4f5e-9e8c-0f3275cfe026 req-33ed6194-5e83-4376-92f3-ba3c8a791b48 service nova] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3e1915dd-e53d-4f5e-9e8c-0f3275cfe026 req-33ed6194-5e83-4376-92f3-ba3c8a791b48 service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3e1915dd-e53d-4f5e-9e8c-0f3275cfe026 req-33ed6194-5e83-4376-92f3-ba3c8a791b48 service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-3e1915dd-e53d-4f5e-9e8c-0f3275cfe026 req-33ed6194-5e83-4376-92f3-ba3c8a791b48 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] No waiting events found dispatching network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:37:14 user nova-compute[75438]: WARNING nova.compute.manager [req-3e1915dd-e53d-4f5e-9e8c-0f3275cfe026 req-33ed6194-5e83-4376-92f3-ba3c8a791b48 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received unexpected event network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e for instance with vm_state building and task_state spawning.
Nov 09 02:37:14 user nova-compute[75438]: INFO nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 09 02:37:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:37:14 user nova-compute[75438]: INFO nova.compute.manager [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Took 29.22 seconds to build instance.
Nov 09 02:37:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e4963077-66e9-41f6-a255-13aef4bdf0f2 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.316s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:37:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:37:41 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid d439e4ed-0ea3-49fc-82bd-a3ccadb8101a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:37:42 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:37:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:37:42 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:37:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:37:47 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:37:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:37:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:37:47 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:37:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:37:48 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:37:48 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=24.966522216796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:37:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:37:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:37:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:37:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:37:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:37:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:37:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:37:56 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:00 user nova-compute[75438]: INFO nova.compute.manager [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Unshelving
Nov 09 02:38:00 user nova-compute[75438]: INFO nova.virt.block_device [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Booting with volume 7ac2738e-23ae-4a98-bec0-b5df6ae4a118 at /dev/vdc
Nov 09 02:38:00 user nova-compute[75438]: DEBUG os_brick.utils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[21601ae8-d512-4def-b639-fc9d9cb557dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b803de0-f509-44ea-afde-1ad5bb93afbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba852b8b-cb8d-4e60-ac2f-8a4ce64401e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe5062a-f854-46c0-8977-7a7123766323]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:38:00 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dc712f-f969-42e0-a840-5b047636864d]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG os_brick.utils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating existing volume attachment record: 32decf2a-f04b-42ae-9944-90dd8403ee41 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:38:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:38:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:38:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Verify base images {{(pid=75438) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75438) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] d439e4ed-0ea3-49fc-82bd-a3ccadb8101a is a valid instance name {{(pid=75438) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 09 02:38:13 user nova-compute[75438]: WARNING nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1
Nov 09 02:38:13 user nova-compute[75438]: WARNING nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0
Nov 09 02:38:13 user nova-compute[75438]: WARNING nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc
Nov 09 02:38:13 user nova-compute[75438]: WARNING nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399
Nov 09 02:38:13 user nova-compute[75438]: WARNING nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead
Nov 09 02:38:13 user nova-compute[75438]: WARNING nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Removable base files: /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1 /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0 /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c456ae7451d63141e3102b3ef01d52b503a4b4e1
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/34be2019f59ca5ac3118a0cda748f54cee53f7e0
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fd0aae8794503ef9345e20e7be1940ba98e09ccc
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1c8b9b1ae291f93c409add4475d13a30decfead
Nov 09 02:38:13 user nova-compute[75438]: INFO nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ee332a1f415858f156373e5fa33d7ca608dc91b
Nov 09 02:38:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Verification complete {{(pid=75438) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Verify swap images {{(pid=75438) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 09 02:38:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.imagecache [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Verify ephemeral images {{(pid=75438) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 09 02:38:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:24 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:24 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'pci_requests' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:24 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'numa_topology' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:38:25 user nova-compute[75438]: INFO nova.compute.claims [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Claim successful on node user
Nov 09 02:38:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:38:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:38:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:25 user nova-compute[75438]: INFO nova.network.neutron [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating port 942fdeac-74d0-497c-8f49-6a9e4e46b86d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 02:38:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing instance network info cache due to event network-changed-942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:38:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Creating image(s)
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'trusted_certs' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Refreshing network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG nova.objects.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<e830b0d8-5d6d-44c6-9439-f757c0a306fe> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "1561582937578000e2b040927bd646c9175c0202" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "1561582937578000e2b040927bd646c9175c0202" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.part --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG nova.virt.images [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] 6bd1d3ab-0721-40b0-b2e2-6ef867c76313 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.part /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updated VIF entry in instance network info cache for port 942fdeac-74d0-497c-8f49-6a9e4e46b86d. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG nova.network.neutron [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c390ab8a-c8c9-40a3-80da-af5babc1f56c req-b890529f-f411-4a35-bba1-48adf66af164 service nova] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.part /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.converted" returned: 0 in 0.269s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "1561582937578000e2b040927bd646c9175c0202" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.509s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202 --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "1561582937578000e2b040927bd646c9175c0202" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "1561582937578000e2b040927bd646c9175c0202" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202 --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202,backing_fmt=raw /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202,backing_fmt=raw /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk 1073741824" returned: 0 in 0.054s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "1561582937578000e2b040927bd646c9175c0202" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1561582937578000e2b040927bd646c9175c0202 --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'migration_context' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG nova.objects.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<e830b0d8-5d6d-44c6-9439-f757c0a306fe> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:38:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Rebasing disk image.
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 -F raw /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 -F raw /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk" returned: 0 in 2.070s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Ensure instance console log exists: /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Start _get_guest_xml network_info=[{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0ed500a4ec560b8aac112a6958da338d',container_format='bare',created_at=2023-11-09T02:36:07Z,direct_url=<?>,disk_format='qcow2',id=6bd1d3ab-0721-40b0-b2e2-6ef867c76313,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1291033211-shelved',owner='04bce2ed85774546969a3751c866b287',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T02:36:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '32decf2a-f04b-42ae-9944-90dd8403ee41', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jiZySsAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e830b0d8-5d6d-44c6-9439-f757c0a306fe', 'attached_at': '', 'detached_at': '', 'volume_id': '7ac2738e-23ae-4a98-bec0-b5df6ae4a118', 'serial': '7ac2738e-23ae-4a98-bec0-b5df6ae4a118'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:38:30 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:38:30 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0ed500a4ec560b8aac112a6958da338d',container_format='bare',created_at=2023-11-09T02:36:07Z,direct_url=<?>,disk_format='qcow2',id=6bd1d3ab-0721-40b0-b2e2-6ef867c76313,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1291033211-shelved',owner='04bce2ed85774546969a3751c866b287',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T02:36:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'vcpu_model' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:30 user nova-compute[75438]: DEBUG nova.objects.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<e830b0d8-5d6d-44c6-9439-f757c0a306fe> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jiZySsAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:38:31 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:38:31 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:38:31 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f5ef97-eaf7-47c6-b5ad-9edaa6ec5264]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:38:31 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5c31aa-93f1-4630-8fce-bb5d462eca46]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118] added
Nov 09 02:38:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[204026dd-368f-42dc-8c64-c8f5ae7a6d4b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b4dabc-5cbb-4a15-8ab5-f1c7cd3c440d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jiZySsAp {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jiZySsAp" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8793e43c-09f8-4c56-a4e8-c6a6b27a9bc7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jiZySsAp'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecbf1b4-b1b7-4ad7-91a5-df8fd491af0f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf18fe1-da32-4649-a319-f6c3c1caa874]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:38:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:38:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[966abe75-46e2-4851-a4ee-5e2ffae0cdc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260]
Nov 09 02:38:31 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260] successful.
Nov 09 02:38:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[168e1487-5b3c-48ba-b385-f0fcc6a8dd5c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab98b10-4424-4c22-96b0-570a3366fc3c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:38:31 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:38:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:38:31 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:38:31 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58c2739-5edd-48bd-971b-7f418bf28dcd]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:38:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jiZySsAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26234396139616561', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234396139616561', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291033211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291033211',id=43,image_ref='6bd1d3ab-0721-40b0-b2e2-6ef867c76313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-203736964',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-9pflvk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member',shelved_at='2023-11-09T02:36:11.059271',shelved_host='user',shelved_image_id='6bd1d3ab-0721-40b0-b2e2-6ef867c76313'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=e830b0d8-5d6d-44c6-9439-f757c0a306fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'pci_devices' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.objects.base [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<e830b0d8-5d6d-44c6-9439-f757c0a306fe> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:38:32 user nova-compute[75438]:   <uuid>e830b0d8-5d6d-44c6-9439-f757c0a306fe</uuid>
Nov 09 02:38:32 user nova-compute[75438]:   <name>instance-0000002b</name>
Nov 09 02:38:32 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:38:32 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:38:32 user nova-compute[75438]:   <metadata>
Nov 09 02:38:32 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:38:32 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:38:32 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1291033211</nova:name>
Nov 09 02:38:32 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:38:30</nova:creationTime>
Nov 09 02:38:32 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:38:32 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:38:32 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:38:32 user nova-compute[75438]:       <nova:owner>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:user uuid="2ff6a04bdbde4baa8a9361a33fe822e9">tempest-AttachVolumeShelveTestJSON-1323114484-project-member</nova:user>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:project uuid="04bce2ed85774546969a3751c866b287">tempest-AttachVolumeShelveTestJSON-1323114484</nova:project>
Nov 09 02:38:32 user nova-compute[75438]:       </nova:owner>
Nov 09 02:38:32 user nova-compute[75438]:       <nova:root type="image" uuid="6bd1d3ab-0721-40b0-b2e2-6ef867c76313"/>
Nov 09 02:38:32 user nova-compute[75438]:       <nova:ports>
Nov 09 02:38:32 user nova-compute[75438]:         <nova:port uuid="942fdeac-74d0-497c-8f49-6a9e4e46b86d">
Nov 09 02:38:32 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 02:38:32 user nova-compute[75438]:         </nova:port>
Nov 09 02:38:32 user nova-compute[75438]:       </nova:ports>
Nov 09 02:38:32 user nova-compute[75438]:     </nova:instance>
Nov 09 02:38:32 user nova-compute[75438]:   </metadata>
Nov 09 02:38:32 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:38:32 user nova-compute[75438]:     <system>
Nov 09 02:38:32 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:38:32 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:38:32 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:38:32 user nova-compute[75438]:       <entry name="serial">e830b0d8-5d6d-44c6-9439-f757c0a306fe</entry>
Nov 09 02:38:32 user nova-compute[75438]:       <entry name="uuid">e830b0d8-5d6d-44c6-9439-f757c0a306fe</entry>
Nov 09 02:38:32 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:38:32 user nova-compute[75438]:     </system>
Nov 09 02:38:32 user nova-compute[75438]:   </sysinfo>
Nov 09 02:38:32 user nova-compute[75438]:   <os>
Nov 09 02:38:32 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:38:32 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:38:32 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:38:32 user nova-compute[75438]:   </os>
Nov 09 02:38:32 user nova-compute[75438]:   <features>
Nov 09 02:38:32 user nova-compute[75438]:     <acpi/>
Nov 09 02:38:32 user nova-compute[75438]:     <apic/>
Nov 09 02:38:32 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:38:32 user nova-compute[75438]:   </features>
Nov 09 02:38:32 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:38:32 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:38:32 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:38:32 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:38:32 user nova-compute[75438]:   </clock>
Nov 09 02:38:32 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:38:32 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:38:32 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:38:32 user nova-compute[75438]:   </cpu>
Nov 09 02:38:32 user nova-compute[75438]:   <devices>
Nov 09 02:38:32 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:38:32 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:38:32 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk"/>
Nov 09 02:38:32 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:38:32 user nova-compute[75438]:     </disk>
Nov 09 02:38:32 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:38:32 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:38:32 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:38:32 user nova-compute[75438]:       <target dev="vdc" bus="virtio"/>
Nov 09 02:38:32 user nova-compute[75438]:       <serial>7ac2738e-23ae-4a98-bec0-b5df6ae4a118</serial>
Nov 09 02:38:32 user nova-compute[75438]:     </disk>
Nov 09 02:38:32 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:38:32 user nova-compute[75438]:       <mac address="fa:16:3e:31:af:cf"/>
Nov 09 02:38:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:38:32 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:38:32 user nova-compute[75438]:       <target dev="tap942fdeac-74"/>
Nov 09 02:38:32 user nova-compute[75438]:     </interface>
Nov 09 02:38:32 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:38:32 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/console.log" append="off"/>
Nov 09 02:38:32 user nova-compute[75438]:     </serial>
Nov 09 02:38:32 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:38:32 user nova-compute[75438]:     <video>
Nov 09 02:38:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:38:32 user nova-compute[75438]:     </video>
Nov 09 02:38:32 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:38:32 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:38:32 user nova-compute[75438]:     </rng>
Nov 09 02:38:32 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:38:32 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:38:32 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:38:32 user nova-compute[75438]:     </memballoon>
Nov 09 02:38:32 user nova-compute[75438]:   </devices>
Nov 09 02:38:32 user nova-compute[75438]: </domain>
Nov 09 02:38:32 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291033211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291033211',id=43,image_ref='6bd1d3ab-0721-40b0-b2e2-6ef867c76313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-203736964',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:34:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-9pflvk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member',shelved_at='2023-11-09T02:36:11.059271',shelved_host='user',shelved_image_id='6bd1d3ab-0721-40b0-b2e2-6ef867c76313'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:38:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=e830b0d8-5d6d-44c6-9439-f757c0a306fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG os_vif [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba57b008-ed5b-5663-b7fc-1b132abf83a5', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap942fdeac-74, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap942fdeac-74, col_values=(('qos', UUID('796796f8-4cd0-4ddd-a6c3-65edf00fae92')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap942fdeac-74, col_values=(('external_ids', {'iface-id': '942fdeac-74d0-497c-8f49-6a9e4e46b86d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:af:cf', 'vm-uuid': 'e830b0d8-5d6d-44c6-9439-f757c0a306fe'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:32 user nova-compute[75438]: INFO os_vif [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74')
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No VIF found with MAC fa:16:3e:31:af:cf, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:38:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-13005e3f-2a63-4b4c-b64d-b29f2cf6d1a8 req-c197b113-7f6e-45bb-b336-fcb564ee18b3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13005e3f-2a63-4b4c-b64d-b29f2cf6d1a8 req-c197b113-7f6e-45bb-b336-fcb564ee18b3 service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13005e3f-2a63-4b4c-b64d-b29f2cf6d1a8 req-c197b113-7f6e-45bb-b336-fcb564ee18b3 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-13005e3f-2a63-4b4c-b64d-b29f2cf6d1a8 req-c197b113-7f6e-45bb-b336-fcb564ee18b3 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-13005e3f-2a63-4b4c-b64d-b29f2cf6d1a8 req-c197b113-7f6e-45bb-b336-fcb564ee18b3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:38:34 user nova-compute[75438]: WARNING nova.compute.manager [req-13005e3f-2a63-4b4c-b64d-b29f2cf6d1a8 req-c197b113-7f6e-45bb-b336-fcb564ee18b3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 02:38:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:38:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance spawned successfully.
Nov 09 02:38:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-1aef4776-ff51-4a15-9b26-30e4c4c1c158 req-5e52cd46-7c55-44cb-9e08-87d591641419 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1aef4776-ff51-4a15-9b26-30e4c4c1c158 req-5e52cd46-7c55-44cb-9e08-87d591641419 service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1aef4776-ff51-4a15-9b26-30e4c4c1c158 req-5e52cd46-7c55-44cb-9e08-87d591641419 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-1aef4776-ff51-4a15-9b26-30e4c4c1c158 req-5e52cd46-7c55-44cb-9e08-87d591641419 service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-1aef4776-ff51-4a15-9b26-30e4c4c1c158 req-5e52cd46-7c55-44cb-9e08-87d591641419 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:38:36 user nova-compute[75438]: WARNING nova.compute.manager [req-1aef4776-ff51-4a15-9b26-30e4c4c1c158 req-5e52cd46-7c55-44cb-9e08-87d591641419 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 02:38:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:38:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-f78406c9-d2e2-49c0-a344-6203dfaf5fff tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.493s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-changed-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Refreshing instance network info cache due to event network-changed-65d244fa-d424-42d3-9531-810994705c9e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Refreshing network info cache for port 65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updated VIF entry in instance network info cache for port 65d244fa-d424-42d3-9531-810994705c9e. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG nova.network.neutron [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:38:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9e518195-7768-4f1f-b10f-9731e073f109 req-4f29cbc4-2c8b-4d2d-ae62-3300d68cdbf4 service nova] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:38:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:38:43 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid d439e4ed-0ea3-49fc-82bd-a3ccadb8101a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:44 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:38:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:38:44 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:38:46 user nova-compute[75438]: INFO nova.compute.claims [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Claim successful on node user
Nov 09 02:38:46 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:38:46 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.policy [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c48f9b9f842438086c55914bfde5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b08c7740da46a8ab8c3856b854ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:38:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Creating image(s)
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "49f18774236ba54e46b78990e87b4e1563b9b49b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "49f18774236ba54e46b78990e87b4e1563b9b49b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:47 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Successfully created port: 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.virt.images [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] 8bfe6a85-28a9-4d95-93bd-9c60f515fb45 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.part /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.part /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.converted" returned: 0 in 0.168s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "49f18774236ba54e46b78990e87b4e1563b9b49b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.935s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "49f18774236ba54e46b78990e87b4e1563b9b49b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "49f18774236ba54e46b78990e87b4e1563b9b49b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Successfully updated port: 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing instance network info cache due to event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b,backing_fmt=raw /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b,backing_fmt=raw /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk 1073741824" returned: 0 in 0.050s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "49f18774236ba54e46b78990e87b4e1563b9b49b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:48 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.neutron [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance network_info: |[{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Cannot resize image /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Ensure instance console log exists: /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Start _get_guest_xml network_info=[{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T02:38:44Z,direct_url=<?>,disk_format='qcow2',id=8bfe6a85-28a9-4d95-93bd-9c60f515fb45,min_disk=0,min_ram=0,name='tempest-scenario-img--1742041783',owner='a1b08c7740da46a8ab8c3856b854ea12',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T02:38:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '8bfe6a85-28a9-4d95-93bd-9c60f515fb45'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:38:49 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:38:49 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T02:38:44Z,direct_url=<?>,disk_format='qcow2',id=8bfe6a85-28a9-4d95-93bd-9c60f515fb45,min_disk=0,min_ram=0,name='tempest-scenario-img--1742041783',owner='a1b08c7740da46a8ab8c3856b854ea12',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T02:38:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-958492107',display_name='tempest-TestMinimumBasicScenario-server-958492107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-958492107',id=46,image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY9+P8l9kEfebd1AbxvPZjIGbSKf9kfHZ/arhCYZWJF/T2u33irNbjdWF0ZIbnMUKh+3SnMfIjxhFepWEi3Ncn9CFZY6Z6RN9zXwMb+MHJvqP+Y07Ro86xVPh0ufhmwYQ==',key_name='tempest-TestMinimumBasicScenario-408172966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-gzz6mrm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:38:47Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=6ed560b3-f605-414a-8838-dda51ec9e9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.objects.instance [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:38:49 user nova-compute[75438]:   <uuid>6ed560b3-f605-414a-8838-dda51ec9e9fd</uuid>
Nov 09 02:38:49 user nova-compute[75438]:   <name>instance-0000002e</name>
Nov 09 02:38:49 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:38:49 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:38:49 user nova-compute[75438]:   <metadata>
Nov 09 02:38:49 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:38:49 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:38:49 user nova-compute[75438]:       <nova:name>tempest-TestMinimumBasicScenario-server-958492107</nova:name>
Nov 09 02:38:49 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:38:49</nova:creationTime>
Nov 09 02:38:49 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:38:49 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:38:49 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:38:49 user nova-compute[75438]:       <nova:owner>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:user uuid="6c48f9b9f842438086c55914bfde5e66">tempest-TestMinimumBasicScenario-1532902727-project-member</nova:user>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:project uuid="a1b08c7740da46a8ab8c3856b854ea12">tempest-TestMinimumBasicScenario-1532902727</nova:project>
Nov 09 02:38:49 user nova-compute[75438]:       </nova:owner>
Nov 09 02:38:49 user nova-compute[75438]:       <nova:root type="image" uuid="8bfe6a85-28a9-4d95-93bd-9c60f515fb45"/>
Nov 09 02:38:49 user nova-compute[75438]:       <nova:ports>
Nov 09 02:38:49 user nova-compute[75438]:         <nova:port uuid="21cb98af-ade9-4e82-99ef-dcd73488ea23">
Nov 09 02:38:49 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:38:49 user nova-compute[75438]:         </nova:port>
Nov 09 02:38:49 user nova-compute[75438]:       </nova:ports>
Nov 09 02:38:49 user nova-compute[75438]:     </nova:instance>
Nov 09 02:38:49 user nova-compute[75438]:   </metadata>
Nov 09 02:38:49 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:38:49 user nova-compute[75438]:     <system>
Nov 09 02:38:49 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:38:49 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:38:49 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:38:49 user nova-compute[75438]:       <entry name="serial">6ed560b3-f605-414a-8838-dda51ec9e9fd</entry>
Nov 09 02:38:49 user nova-compute[75438]:       <entry name="uuid">6ed560b3-f605-414a-8838-dda51ec9e9fd</entry>
Nov 09 02:38:49 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:38:49 user nova-compute[75438]:     </system>
Nov 09 02:38:49 user nova-compute[75438]:   </sysinfo>
Nov 09 02:38:49 user nova-compute[75438]:   <os>
Nov 09 02:38:49 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:38:49 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:38:49 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:38:49 user nova-compute[75438]:   </os>
Nov 09 02:38:49 user nova-compute[75438]:   <features>
Nov 09 02:38:49 user nova-compute[75438]:     <acpi/>
Nov 09 02:38:49 user nova-compute[75438]:     <apic/>
Nov 09 02:38:49 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:38:49 user nova-compute[75438]:   </features>
Nov 09 02:38:49 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:38:49 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:38:49 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:38:49 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:38:49 user nova-compute[75438]:   </clock>
Nov 09 02:38:49 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:38:49 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:38:49 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:38:49 user nova-compute[75438]:   </cpu>
Nov 09 02:38:49 user nova-compute[75438]:   <devices>
Nov 09 02:38:49 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:38:49 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:38:49 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk"/>
Nov 09 02:38:49 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:38:49 user nova-compute[75438]:     </disk>
Nov 09 02:38:49 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:38:49 user nova-compute[75438]:       <mac address="fa:16:3e:e0:fd:da"/>
Nov 09 02:38:49 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:38:49 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:38:49 user nova-compute[75438]:       <target dev="tap21cb98af-ad"/>
Nov 09 02:38:49 user nova-compute[75438]:     </interface>
Nov 09 02:38:49 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:38:49 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/console.log" append="off"/>
Nov 09 02:38:49 user nova-compute[75438]:     </serial>
Nov 09 02:38:49 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:38:49 user nova-compute[75438]:     <video>
Nov 09 02:38:49 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:38:49 user nova-compute[75438]:     </video>
Nov 09 02:38:49 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:38:49 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:38:49 user nova-compute[75438]:     </rng>
Nov 09 02:38:49 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:38:49 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:38:49 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:38:49 user nova-compute[75438]:     </memballoon>
Nov 09 02:38:49 user nova-compute[75438]:   </devices>
Nov 09 02:38:49 user nova-compute[75438]: </domain>
Nov 09 02:38:49 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-958492107',display_name='tempest-TestMinimumBasicScenario-server-958492107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-958492107',id=46,image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY9+P8l9kEfebd1AbxvPZjIGbSKf9kfHZ/arhCYZWJF/T2u33irNbjdWF0ZIbnMUKh+3SnMfIjxhFepWEi3Ncn9CFZY6Z6RN9zXwMb+MHJvqP+Y07Ro86xVPh0ufhmwYQ==',key_name='tempest-TestMinimumBasicScenario-408172966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-gzz6mrm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:38:47Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=6ed560b3-f605-414a-8838-dda51ec9e9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG os_vif [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6ace8f9-b523-59b3-a2ae-727c1742f0cb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21cb98af-ad, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21cb98af-ad, col_values=(('qos', UUID('82ab530e-0d97-467d-8af4-0137cee880fc')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21cb98af-ad, col_values=(('external_ids', {'iface-id': '21cb98af-ade9-4e82-99ef-dcd73488ea23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:fd:da', 'vm-uuid': '6ed560b3-f605-414a-8838-dda51ec9e9fd'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:38:49 user nova-compute[75438]: INFO os_vif [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad')
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No VIF found with MAC fa:16:3e:e0:fd:da, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated VIF entry in instance network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0f0f89da-399d-458a-a426-bf01faea9c2d req-c87fc699-ae8c-4957-9dac-00df7d0c21cb service nova] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:49 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:38:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-fc3e3b58-a0f2-480c-93d3-84ca4c831efb req-1873d1be-58b9-47e3-9a70-486f2fa9317b service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fc3e3b58-a0f2-480c-93d3-84ca4c831efb req-1873d1be-58b9-47e3-9a70-486f2fa9317b service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fc3e3b58-a0f2-480c-93d3-84ca4c831efb req-1873d1be-58b9-47e3-9a70-486f2fa9317b service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fc3e3b58-a0f2-480c-93d3-84ca4c831efb req-1873d1be-58b9-47e3-9a70-486f2fa9317b service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-fc3e3b58-a0f2-480c-93d3-84ca4c831efb req-1873d1be-58b9-47e3-9a70-486f2fa9317b service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:38:51 user nova-compute[75438]: WARNING nova.compute.manager [req-fc3e3b58-a0f2-480c-93d3-84ca4c831efb req-1873d1be-58b9-47e3-9a70-486f2fa9317b service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state building and task_state spawning.
Nov 09 02:38:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:52 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:38:52 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8631MB free_disk=24.86874008178711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e830b0d8-5d6d-44c6-9439-f757c0a306fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6ed560b3-f605-414a-8838-dda51ec9e9fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:38:53 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance spawned successfully.
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-198fd846-fde7-45ca-8253-e17204ff8378 req-c883f0b4-e9e1-4f92-9df2-fcde86e6e9fe service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-198fd846-fde7-45ca-8253-e17204ff8378 req-c883f0b4-e9e1-4f92-9df2-fcde86e6e9fe service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-198fd846-fde7-45ca-8253-e17204ff8378 req-c883f0b4-e9e1-4f92-9df2-fcde86e6e9fe service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-198fd846-fde7-45ca-8253-e17204ff8378 req-c883f0b4-e9e1-4f92-9df2-fcde86e6e9fe service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.compute.manager [req-198fd846-fde7-45ca-8253-e17204ff8378 req-c883f0b4-e9e1-4f92-9df2-fcde86e6e9fe service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:38:53 user nova-compute[75438]: WARNING nova.compute.manager [req-198fd846-fde7-45ca-8253-e17204ff8378 req-c883f0b4-e9e1-4f92-9df2-fcde86e6e9fe service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state building and task_state spawning.
Nov 09 02:38:53 user nova-compute[75438]: INFO nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 09 02:38:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:38:53 user nova-compute[75438]: INFO nova.compute.manager [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Took 6.57 seconds to build instance.
Nov 09 02:38:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-e916231c-2b59-42e4-af91-22ed9ad7d1e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.680s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:38:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:38:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "143b24bd-7ae6-48e4-94bc-31978545246c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:38:59 user nova-compute[75438]: INFO nova.compute.claims [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Claim successful on node user
Nov 09 02:38:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:38:59 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.policy [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b5297e15fd14f1395cb606e791c4202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6c21c58de14dbda4534441cad48918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:38:59 user nova-compute[75438]: INFO nova.virt.block_device [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Booting with volume 6948f0fd-b522-42cf-94c0-eb35492543aa at /dev/vda
Nov 09 02:38:59 user nova-compute[75438]: DEBUG os_brick.utils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d6108f-d90b-4551-ab88-7110379b3e59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e98857-8861-494e-bb88-ee05fc7fa34b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a8781a-14e8-49b9-994b-ff44b46e0f40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a913ef0b-868f-4474-937a-91161f117d43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:38:59 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:38:59 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d472211-118e-46a9-947a-560cfb9a2a22]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG os_brick.utils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:38:59 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updating existing volume attachment record: 68c1a9bc-1341-4baf-b38e-7ef3e6a47522 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:39:00 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Successfully created port: 2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:39:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Successfully updated port: 2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquired lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-changed-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG nova.compute.manager [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Refreshing instance network info cache due to event network-changed-2a388047-1932-4dcd-80c6-a4d876c32fe8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] Acquiring lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:39:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updating instance_info_cache with network_info: [{"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Releasing lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Instance network_info: |[{"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] Acquired lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Refreshing network info cache for port 2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updated VIF entry in instance network info cache for port 2a388047-1932-4dcd-80c6-a4d876c32fe8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updating instance_info_cache with network_info: [{"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:39:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-2671db30-fcd0-4ac1-ad63-fe18eac8dd15 req-92ba2580-a702-4c42-94ae-9b4d957ec5dd service nova] Releasing lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:39:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:39:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:39:23 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Creating image(s)
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Did not create local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Ensure instance console log exists: /opt/stack/data/nova/instances/143b24bd-7ae6-48e4-94bc-31978545246c/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Start _get_guest_xml network_info=[{"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '68c1a9bc-1341-4baf-b38e-7ef3e6a47522', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azClJYHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '143b24bd-7ae6-48e4-94bc-31978545246c', 'attached_at': '', 'detached_at': '', 'volume_id': '6948f0fd-b522-42cf-94c0-eb35492543aa', 'serial': '6948f0fd-b522-42cf-94c0-eb35492543aa'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:39:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:39:23 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azClJYHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:39:23 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:39:23 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:39:23 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9590901d-8aa4-4812-b6be-1bca10511e1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:39:23 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab6fc99-f7cf-4e48-a020-8590434d8c70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa] added
Nov 09 02:39:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ec766c-9f97-4bbc-8ed4-fceccb29f465]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c5b9b2-047a-49d9-9d5c-056f987918ce]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azClJYHX {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azClJYHX" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7efbce-b89a-4a96-882e-5983799f23cb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'azClJYHX'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a292026-6461-4991-abe2-424a7c6c9008]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd872314-9f30-43c6-a9a5-7d0f083a882d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:39:23 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:39:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:39:23 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:39:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3017b8-67b1-4dd1-9bf3-ece2dcd4c1f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260]
Nov 09 02:39:23 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260] successful.
Nov 09 02:39:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcdc1b0-799a-4a48-bbd1-6dbc19943a7b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e06907-42bd-4e67-bb0f-ca9b79e56935]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:39:23 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:39:23 user nova-compute[75438]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)
Nov 09 02:39:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:39:23 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:39:23 user nova-compute[75438]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)
Nov 09 02:39:23 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:39:23 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:24 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:24 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d915ed-d9da-4f05-8971-de2577137d50]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:39:24 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:39:24 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azClJYHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23362613032633161', 'path': '/dev/sdd'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362613032633161', 'path': '/dev/sdd'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1955567376',display_name='tempest-TestVolumeBootPattern-server-1955567376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1955567376',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-50p3xk68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:39:00Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=143b24bd-7ae6-48e4-94bc-31978545246c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'pci_devices' on Instance uuid 143b24bd-7ae6-48e4-94bc-31978545246c {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:39:25 user nova-compute[75438]:   <uuid>143b24bd-7ae6-48e4-94bc-31978545246c</uuid>
Nov 09 02:39:25 user nova-compute[75438]:   <name>instance-0000002f</name>
Nov 09 02:39:25 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:39:25 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:39:25 user nova-compute[75438]:   <metadata>
Nov 09 02:39:25 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:39:25 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:39:25 user nova-compute[75438]:       <nova:name>tempest-TestVolumeBootPattern-server-1955567376</nova:name>
Nov 09 02:39:25 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:39:23</nova:creationTime>
Nov 09 02:39:25 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:39:25 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:39:25 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:39:25 user nova-compute[75438]:       <nova:owner>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:user uuid="3b5297e15fd14f1395cb606e791c4202">tempest-TestVolumeBootPattern-1394927917-project-member</nova:user>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:project uuid="8f6c21c58de14dbda4534441cad48918">tempest-TestVolumeBootPattern-1394927917</nova:project>
Nov 09 02:39:25 user nova-compute[75438]:       </nova:owner>
Nov 09 02:39:25 user nova-compute[75438]:       <nova:ports>
Nov 09 02:39:25 user nova-compute[75438]:         <nova:port uuid="2a388047-1932-4dcd-80c6-a4d876c32fe8">
Nov 09 02:39:25 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 09 02:39:25 user nova-compute[75438]:         </nova:port>
Nov 09 02:39:25 user nova-compute[75438]:       </nova:ports>
Nov 09 02:39:25 user nova-compute[75438]:     </nova:instance>
Nov 09 02:39:25 user nova-compute[75438]:   </metadata>
Nov 09 02:39:25 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:39:25 user nova-compute[75438]:     <system>
Nov 09 02:39:25 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:39:25 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:39:25 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:39:25 user nova-compute[75438]:       <entry name="serial">143b24bd-7ae6-48e4-94bc-31978545246c</entry>
Nov 09 02:39:25 user nova-compute[75438]:       <entry name="uuid">143b24bd-7ae6-48e4-94bc-31978545246c</entry>
Nov 09 02:39:25 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:39:25 user nova-compute[75438]:     </system>
Nov 09 02:39:25 user nova-compute[75438]:   </sysinfo>
Nov 09 02:39:25 user nova-compute[75438]:   <os>
Nov 09 02:39:25 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:39:25 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:39:25 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:39:25 user nova-compute[75438]:   </os>
Nov 09 02:39:25 user nova-compute[75438]:   <features>
Nov 09 02:39:25 user nova-compute[75438]:     <acpi/>
Nov 09 02:39:25 user nova-compute[75438]:     <apic/>
Nov 09 02:39:25 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:39:25 user nova-compute[75438]:   </features>
Nov 09 02:39:25 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:39:25 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:39:25 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:39:25 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:39:25 user nova-compute[75438]:   </clock>
Nov 09 02:39:25 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:39:25 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:39:25 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:39:25 user nova-compute[75438]:   </cpu>
Nov 09 02:39:25 user nova-compute[75438]:   <devices>
Nov 09 02:39:25 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:39:25 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:39:25 user nova-compute[75438]:       <source dev="/dev/sdd"/>
Nov 09 02:39:25 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:39:25 user nova-compute[75438]:       <serial>6948f0fd-b522-42cf-94c0-eb35492543aa</serial>
Nov 09 02:39:25 user nova-compute[75438]:     </disk>
Nov 09 02:39:25 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:39:25 user nova-compute[75438]:       <mac address="fa:16:3e:13:d3:70"/>
Nov 09 02:39:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:39:25 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:39:25 user nova-compute[75438]:       <target dev="tap2a388047-19"/>
Nov 09 02:39:25 user nova-compute[75438]:     </interface>
Nov 09 02:39:25 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:39:25 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/143b24bd-7ae6-48e4-94bc-31978545246c/console.log" append="off"/>
Nov 09 02:39:25 user nova-compute[75438]:     </serial>
Nov 09 02:39:25 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:39:25 user nova-compute[75438]:     <video>
Nov 09 02:39:25 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:39:25 user nova-compute[75438]:     </video>
Nov 09 02:39:25 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:39:25 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:39:25 user nova-compute[75438]:     </rng>
Nov 09 02:39:25 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:39:25 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:39:25 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:39:25 user nova-compute[75438]:     </memballoon>
Nov 09 02:39:25 user nova-compute[75438]:   </devices>
Nov 09 02:39:25 user nova-compute[75438]: </domain>
Nov 09 02:39:25 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1955567376',display_name='tempest-TestVolumeBootPattern-server-1955567376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1955567376',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-50p3xk68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:39:00Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=143b24bd-7ae6-48e4-94bc-31978545246c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG os_vif [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fc5a47f-616b-59ae-8e17-69053fbdd808', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a388047-19, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a388047-19, col_values=(('qos', UUID('8682b7bf-c211-4422-8262-c29d864914a9')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a388047-19, col_values=(('external_ids', {'iface-id': '2a388047-1932-4dcd-80c6-a4d876c32fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:d3:70', 'vm-uuid': '143b24bd-7ae6-48e4-94bc-31978545246c'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:25 user nova-compute[75438]: INFO os_vif [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19')
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:39:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] No VIF found with MAC fa:16:3e:13:d3:70, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-3ce2abb7-6aa1-45c5-a4a7-5b2f24817ed1 req-e30f1798-9abf-4da9-b219-1a3d4d260197 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3ce2abb7-6aa1-45c5-a4a7-5b2f24817ed1 req-e30f1798-9abf-4da9-b219-1a3d4d260197 service nova] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3ce2abb7-6aa1-45c5-a4a7-5b2f24817ed1 req-e30f1798-9abf-4da9-b219-1a3d4d260197 service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-3ce2abb7-6aa1-45c5-a4a7-5b2f24817ed1 req-e30f1798-9abf-4da9-b219-1a3d4d260197 service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-3ce2abb7-6aa1-45c5-a4a7-5b2f24817ed1 req-e30f1798-9abf-4da9-b219-1a3d4d260197 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] No waiting events found dispatching network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:39:26 user nova-compute[75438]: WARNING nova.compute.manager [req-3ce2abb7-6aa1-45c5-a4a7-5b2f24817ed1 req-e30f1798-9abf-4da9-b219-1a3d4d260197 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received unexpected event network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 for instance with vm_state building and task_state spawning.
Nov 09 02:39:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid d439e4ed-0ea3-49fc-82bd-a3ccadb8101a {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 143b24bd-7ae6-48e4-94bc-31978545246c {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:39:28 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Instance spawned successfully.
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:39:28 user nova-compute[75438]: INFO nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-bd2e1692-945f-401e-8630-6799d169c246 req-419da824-ee6f-4e73-ae78-22b8210fc5ef service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bd2e1692-945f-401e-8630-6799d169c246 req-419da824-ee6f-4e73-ae78-22b8210fc5ef service nova] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bd2e1692-945f-401e-8630-6799d169c246 req-419da824-ee6f-4e73-ae78-22b8210fc5ef service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-bd2e1692-945f-401e-8630-6799d169c246 req-419da824-ee6f-4e73-ae78-22b8210fc5ef service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-bd2e1692-945f-401e-8630-6799d169c246 req-419da824-ee6f-4e73-ae78-22b8210fc5ef service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] No waiting events found dispatching network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:39:28 user nova-compute[75438]: WARNING nova.compute.manager [req-bd2e1692-945f-401e-8630-6799d169c246 req-419da824-ee6f-4e73-ae78-22b8210fc5ef service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received unexpected event network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 for instance with vm_state building and task_state spawning.
Nov 09 02:39:28 user nova-compute[75438]: INFO nova.compute.manager [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Took 29.63 seconds to build instance.
Nov 09 02:39:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-c5848e02-6b3c-4aa2-96b8-2a771827e923 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "143b24bd-7ae6-48e4-94bc-31978545246c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.750s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "143b24bd-7ae6-48e4-94bc-31978545246c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.863s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:28 user nova-compute[75438]: INFO nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 09 02:39:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "143b24bd-7ae6-48e4-94bc-31978545246c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:39:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:39:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [{"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:39:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-e830b0d8-5d6d-44c6-9439-f757c0a306fe" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:39:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:39:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:39:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:50 user nova-compute[75438]: INFO nova.compute.manager [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Detaching volume 7ac2738e-23ae-4a98-bec0-b5df6ae4a118
Nov 09 02:39:50 user nova-compute[75438]: INFO nova.virt.block_device [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Attempting to driver detach volume 7ac2738e-23ae-4a98-bec0-b5df6ae4a118 from mountpoint /dev/vdc
Nov 09 02:39:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Attempting to detach device vdc from instance e830b0d8-5d6d-44c6-9439-f757c0a306fe from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:39:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:39:50 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:39:50 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:39:50 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:39:50 user nova-compute[75438]:   <serial>7ac2738e-23ae-4a98-bec0-b5df6ae4a118</serial>
Nov 09 02:39:50 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:39:50 user nova-compute[75438]: </disk>
Nov 09 02:39:50 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:39:50 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully detached device vdc from instance e830b0d8-5d6d-44c6-9439-f757c0a306fe from the persistent domain config.
Nov 09 02:39:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e830b0d8-5d6d-44c6-9439-f757c0a306fe from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:39:50 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:39:50 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:39:50 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:39:50 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:39:50 user nova-compute[75438]:   <serial>7ac2738e-23ae-4a98-bec0-b5df6ae4a118</serial>
Nov 09 02:39:50 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:39:50 user nova-compute[75438]: </disk>
Nov 09 02:39:50 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:39:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:39:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:39:53 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:39:53 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=24.837974548339844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance e830b0d8-5d6d-44c6-9439-f757c0a306fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6ed560b3-f605-414a-8838-dda51ec9e9fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 143b24bd-7ae6-48e4-94bc-31978545246c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:39:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:39:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:39:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:39:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:11 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e830b0d8-5d6d-44c6-9439-f757c0a306fe is timed out.
Nov 09 02:40:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully detached device vdc from instance e830b0d8-5d6d-44c6-9439-f757c0a306fe from the live domain config.
Nov 09 02:40:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jiZySsAp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:40:11 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c17263-9c07-432a-b44f-dd3d171c92ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:40:11 user nova-compute[75438]: No targets found.
Nov 09 02:40:11 user nova-compute[75438]: iSNS:
Nov 09 02:40:11 user nova-compute[75438]: No targets found.
Nov 09 02:40:11 user nova-compute[75438]: STATIC:
Nov 09 02:40:11 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b
Nov 09 02:40:11 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:40:11 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:40:11 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa
Nov 09 02:40:11 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:40:11 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:40:11 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118
Nov 09 02:40:11 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:40:11 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:40:11 user nova-compute[75438]: FIRMWARE:
Nov 09 02:40:11 user nova-compute[75438]: No targets found.
Nov 09 02:40:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:40:11 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:40:11 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ffa122-70dd-4f01-bdbb-d7ae3652bdce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6961596-2a2f-4144-a638-c78a7443b476]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:40:11 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:40:11 user nova-compute[75438]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)
Nov 09 02:40:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:40:11 user nova-compute[75438]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 (non-flash)
Nov 09 02:40:11 user nova-compute[75438]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)
Nov 09 02:40:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba04361e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d722f-0308-4d64-ad9b-264f27fbd52a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[548db2c5-ca56-44e4-b9da-8e3ac3546bdb]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca391d7-8a4f-49b8-b398-65773fc4720f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[568e9a29-dbf3-4acc-b9b7-62e302aebabc]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e02e5-5f3f-4626-975a-9b3b64878a47]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2a6b7b-a407-4e66-a2bf-13af3695c83d]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260]
Nov 09 02:40:11 user nova-compute[75438]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118, portal: 172.16.0.220,3260] successful.
Nov 09 02:40:11 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ac2738e-23ae-4a98-bec0-b5df6ae4a118 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85baa35-2a81-4759-8369-a9e3f4468aa0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] <== disconnect_volume: return (302ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:40:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:40:12 user nova-compute[75438]: DEBUG nova.objects.instance [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'flavor' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:40:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9ffa58e9-812a-4a08-b2f0-dda96a2eda0f tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:40 user nova-compute[75438]: INFO nova.compute.manager [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Terminating instance
Nov 09 02:40:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-525834a8-e947-4b07-9037-4de320096960 req-bb42021e-c30d-4e52-bb7e-e0768038ea3b service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-unplugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-525834a8-e947-4b07-9037-4de320096960 req-bb42021e-c30d-4e52-bb7e-e0768038ea3b service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-525834a8-e947-4b07-9037-4de320096960 req-bb42021e-c30d-4e52-bb7e-e0768038ea3b service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-525834a8-e947-4b07-9037-4de320096960 req-bb42021e-c30d-4e52-bb7e-e0768038ea3b service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-525834a8-e947-4b07-9037-4de320096960 req-bb42021e-c30d-4e52-bb7e-e0768038ea3b service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-unplugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.compute.manager [req-525834a8-e947-4b07-9037-4de320096960 req-bb42021e-c30d-4e52-bb7e-e0768038ea3b service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-unplugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Instance destroyed successfully.
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.objects.instance [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'resources' on Instance uuid e830b0d8-5d6d-44c6-9439-f757c0a306fe {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1291033211',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1291033211',id=43,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVlhSmcojpUvdS8JaRIrxYMsrdL5rdChxOu+fl7YSi5In3y/Xc93zCHTFADOktojsReZz3FsE1CfBi5LIfh4WIueQRgsFn0D92X0g//dDa/s/TKbVXLVOvZ55ZlfnMgg==',key_name='tempest-keypair-203736964',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-9pflvk0o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=e830b0d8-5d6d-44c6-9439-f757c0a306fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "address": "fa:16:3e:31:af:cf", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942fdeac-74", "ovs_interfaceid": "942fdeac-74d0-497c-8f49-6a9e4e46b86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG os_vif [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap942fdeac-74, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=796796f8-4cd0-4ddd-a6c3-65edf00fae92) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:41 user nova-compute[75438]: INFO os_vif [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:af:cf,bridge_name='br-int',has_traffic_filtering=True,id=942fdeac-74d0-497c-8f49-6a9e4e46b86d,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942fdeac-74')
Nov 09 02:40:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Deleting instance files /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe_del
Nov 09 02:40:41 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Deletion of /opt/stack/data/nova/instances/e830b0d8-5d6d-44c6-9439-f757c0a306fe_del complete
Nov 09 02:40:41 user nova-compute[75438]: INFO nova.compute.manager [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 09 02:40:41 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:40:41 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-93270092-7d8f-4174-abe9-d72dbf098ed7 req-c8d73d54-220e-42d1-a864-3527ae82f3a3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-deleted-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:42 user nova-compute[75438]: INFO nova.compute.manager [req-93270092-7d8f-4174-abe9-d72dbf098ed7 req-c8d73d54-220e-42d1-a864-3527ae82f3a3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Neutron deleted interface 942fdeac-74d0-497c-8f49-6a9e4e46b86d; detaching it from the instance and deleting it from the info cache
Nov 09 02:40:42 user nova-compute[75438]: DEBUG nova.network.neutron [req-93270092-7d8f-4174-abe9-d72dbf098ed7 req-c8d73d54-220e-42d1-a864-3527ae82f3a3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:40:42 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Took 0.75 seconds to deallocate network for instance.
Nov 09 02:40:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-93270092-7d8f-4174-abe9-d72dbf098ed7 req-c8d73d54-220e-42d1-a864-3527ae82f3a3 service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Detach interface failed, port_id=942fdeac-74d0-497c-8f49-6a9e4e46b86d, reason: Instance e830b0d8-5d6d-44c6-9439-f757c0a306fe could not be found. {{(pid=75438) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:40:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:42 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Deleted allocations for instance e830b0d8-5d6d-44c6-9439-f757c0a306fe
Nov 09 02:40:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1552f78b-b60a-4493-81d8-2f6eb623e8e8 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-6dfcdb15-c535-4451-9495-10fac70f8e02 req-a8b1ffec-43c5-47fd-9708-e43389ef9dae service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6dfcdb15-c535-4451-9495-10fac70f8e02 req-a8b1ffec-43c5-47fd-9708-e43389ef9dae service nova] Acquiring lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6dfcdb15-c535-4451-9495-10fac70f8e02 req-a8b1ffec-43c5-47fd-9708-e43389ef9dae service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6dfcdb15-c535-4451-9495-10fac70f8e02 req-a8b1ffec-43c5-47fd-9708-e43389ef9dae service nova] Lock "e830b0d8-5d6d-44c6-9439-f757c0a306fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-6dfcdb15-c535-4451-9495-10fac70f8e02 req-a8b1ffec-43c5-47fd-9708-e43389ef9dae service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] No waiting events found dispatching network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:40:43 user nova-compute[75438]: WARNING nova.compute.manager [req-6dfcdb15-c535-4451-9495-10fac70f8e02 req-a8b1ffec-43c5-47fd-9708-e43389ef9dae service nova] [instance: e830b0d8-5d6d-44c6-9439-f757c0a306fe] Received unexpected event network-vif-plugged-942fdeac-74d0-497c-8f49-6a9e4e46b86d for instance with vm_state deleted and task_state None.
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'flavor' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:43 user nova-compute[75438]: INFO nova.compute.manager [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Attaching volume 555cac18-51d9-4cb9-a142-6a01f3fe3ffe to /dev/vdb
Nov 09 02:40:43 user nova-compute[75438]: DEBUG os_brick.utils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f46c300-1a57-44c0-81b8-da7e06ccffb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aef31d5-a646-446c-a7e8-6ee21e6d839e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[790d01f4-7b21-43e7-b1b7-82598c817196]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8978f6f5-5f23-440d-b389-e90735b7d20f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:40:43 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:40:43 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5484573-44f8-4dfe-adf5-4518838530a2]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG os_brick.utils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:40:43 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating existing volume attachment record: 9a3dc31b-8a66-4532-b861-cfd3100e6a11 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:40:46 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid d439e4ed-0ea3-49fc-82bd-a3ccadb8101a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:40:47 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:40:47 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:40:47 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:40:49 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-changed-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Refreshing instance network info cache due to event network-changed-2a388047-1932-4dcd-80c6-a4d876c32fe8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] Acquiring lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] Acquired lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG nova.network.neutron [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Refreshing network info cache for port 2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG nova.network.neutron [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updated VIF entry in instance network info cache for port 2a388047-1932-4dcd-80c6-a4d876c32fe8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG nova.network.neutron [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updating instance_info_cache with network_info: [{"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e2d1727b-f910-4c92-8baa-681f6cc5ec31 req-e942bd10-4cff-4fa4-a093-f24282937864 service nova] Releasing lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-changed-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG nova.compute.manager [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Refreshing instance network info cache due to event network-changed-2a388047-1932-4dcd-80c6-a4d876c32fe8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] Acquiring lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] Acquired lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG nova.network.neutron [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Refreshing network info cache for port 2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "143b24bd-7ae6-48e4-94bc-31978545246c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:51 user nova-compute[75438]: INFO nova.compute.manager [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Terminating instance
Nov 09 02:40:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG nova.network.neutron [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updated VIF entry in instance network info cache for port 2a388047-1932-4dcd-80c6-a4d876c32fe8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG nova.network.neutron [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updating instance_info_cache with network_info: [{"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:40:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fb4d74d8-01d1-46d0-a92d-1276ffbb4415 req-97fe498a-56fc-4469-87e2-22ad664d9d24 service nova] Releasing lock "refresh_cache-143b24bd-7ae6-48e4-94bc-31978545246c" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:40:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Instance destroyed successfully.
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'resources' on Instance uuid 143b24bd-7ae6-48e4-94bc-31978545246c {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1955567376',display_name='tempest-TestVolumeBootPattern-server-1955567376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1955567376',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:39:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-50p3xk68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:39:29Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=143b24bd-7ae6-48e4-94bc-31978545246c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "address": "fa:16:3e:13:d3:70", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a388047-19", "ovs_interfaceid": "2a388047-1932-4dcd-80c6-a4d876c32fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_vif [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a388047-19, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8682b7bf-c211-4422-8262-c29d864914a9) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:40:52 user nova-compute[75438]: INFO os_vif [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:d3:70,bridge_name='br-int',has_traffic_filtering=True,id=2a388047-1932-4dcd-80c6-a4d876c32fe8,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a388047-19')
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azClJYHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:40:52 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24c2009-8609-441a-b5f2-1037d6915423]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:40:52 user nova-compute[75438]: No targets found.
Nov 09 02:40:52 user nova-compute[75438]: iSNS:
Nov 09 02:40:52 user nova-compute[75438]: No targets found.
Nov 09 02:40:52 user nova-compute[75438]: STATIC:
Nov 09 02:40:52 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b
Nov 09 02:40:52 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:40:52 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:40:52 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa
Nov 09 02:40:52 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:40:52 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:40:52 user nova-compute[75438]: FIRMWARE:
Nov 09 02:40:52 user nova-compute[75438]: No targets found.
Nov 09 02:40:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:40:52 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:40:52 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ae26bc-ac47-4974-b5df-1728e33c8063]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d9546b-197b-45d8-a0ae-a1e2d335effc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:40:52 user nova-compute[75438]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)
Nov 09 02:40:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:40:52 user nova-compute[75438]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa (non-flash)
Nov 09 02:40:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0429b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa'): ({'sdd'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Removing single pathed devices sdd {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4070316b-7f89-451e-af74-ceb576bf354b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d1991f-c9ca-48c9-a9f2-0144a9946b58]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flushing IO for device /dev/sdd {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52d06dc-3171-4432-a5eb-bfc88940ebf7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a882d39-4ab7-4e09-aa83-4c40ed977bc4]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] SCSI volumes sdd have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d5f12e1e', '/dev/disk/by-id/scsi-1SCST_BIOd5f12e1e-3ba02c1ad266450e', '/dev/disk/by-id/scsi-23362613032633161') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 02:40:52 user nova-compute[75438]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_d5f12e1e
Nov 09 02:40:52 user nova-compute[75438]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOd5f12e1e-3ba02c1ad266450e
Nov 09 02:40:52 user nova-compute[75438]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23362613032633161
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea3ca5a-a628-4918-a6a4-68061b056c83]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[997b18c7-84aa-4fd9-8b73-d917cba40da1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-vif-unplugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] No waiting events found dispatching network-vif-unplugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-vif-unplugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] Acquiring lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] Lock "143b24bd-7ae6-48e4-94bc-31978545246c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.manager [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] No waiting events found dispatching network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:40:52 user nova-compute[75438]: WARNING nova.compute.manager [req-d6778918-59d7-40d8-af86-6b9507bf776b req-f0207da8-1a91-438d-ae2c-aadbc0874ac2 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received unexpected event network-vif-plugged-2a388047-1932-4dcd-80c6-a4d876c32fe8 for instance with vm_state active and task_state deleting.
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5557462-c44d-4e9e-96cf-b46467cd2a17]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260]
Nov 09 02:40:52 user nova-compute[75438]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa, portal: 172.16.0.220,3260] successful.
Nov 09 02:40:52 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6948f0fd-b522-42cf-94c0-eb35492543aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbda49e-be88-48e5-8173-fc5930a0048c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== disconnect_volume: return (316ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:40:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Deleting instance files /opt/stack/data/nova/instances/143b24bd-7ae6-48e4-94bc-31978545246c_del
Nov 09 02:40:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Deletion of /opt/stack/data/nova/instances/143b24bd-7ae6-48e4-94bc-31978545246c_del complete
Nov 09 02:40:52 user nova-compute[75438]: INFO nova.compute.manager [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:40:52 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:40:53 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Took 0.45 seconds to deallocate network for instance.
Nov 09 02:40:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:40:53 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:40:53 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=24.864757537841797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6ed560b3-f605-414a-8838-dda51ec9e9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 143b24bd-7ae6-48e4-94bc-31978545246c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:40:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:53 user nova-compute[75438]: INFO nova.compute.manager [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Took 0.93 seconds to detach 1 volumes for instance.
Nov 09 02:40:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:40:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:40:54 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:40:54 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:40:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:54 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Deleted allocations for instance 143b24bd-7ae6-48e4-94bc-31978545246c
Nov 09 02:40:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4f2233ca-59e0-44f9-b8df-a8dec51ac866 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "143b24bd-7ae6-48e4-94bc-31978545246c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.888s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:40:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-0eb620a1-b8e0-4cd5-96e7-373221b17b91 req-d295f1b8-e550-4c61-94dc-fcb10e1c5630 service nova] [instance: 143b24bd-7ae6-48e4-94bc-31978545246c] Received event network-vif-deleted-2a388047-1932-4dcd-80c6-a4d876c32fe8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:40:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:40:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:40:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:41:06 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:41:06 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:41:06 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d57f6-5e5e-4efa-bf08-74a8c9c2755f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:41:06 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0412b981-46a5-4954-8463-357ef74ef304]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe] added
Nov 09 02:41:06 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec330de-4c01-43b7-ae53-09ea73701592]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424e727-9b02-4246-919c-2083e3c284f2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFmteKVb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFmteKVb" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[52def357-32a6-4822-bf72-95c3eebcdb00]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFmteKVb'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[19033fb3-bd11-4a6c-a3ec-70506c946a81]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac280b45-4fe6-4443-97ac-bc68b5bf1b0a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:06 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:06 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[51852655-721f-412a-8c9a-e7eae342d47a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]
Nov 09 02:41:06 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.
Nov 09 02:41:06 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ff0a8d-f8eb-4d19-baa5-0bd8b45986a9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d496aa-3b1a-40da-804a-aeb02e0545a6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:06 user nova-compute[75438]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:41:06 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:06 user nova-compute[75438]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:41:06 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[17acc283-4000-4878-a36f-cd56d6e09ad0]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:41:06 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:41:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:41:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26134376463393733', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:41:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134376463393733', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:41:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'flavor' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:41:07 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:41:07 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:41:07 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:41:07 user nova-compute[75438]:   <serial>555cac18-51d9-4cb9-a142-6a01f3fe3ffe</serial>
Nov 09 02:41:07 user nova-compute[75438]: </disk>
Nov 09 02:41:07 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:41:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:41:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:41:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No VIF found with MAC fa:16:3e:e0:fd:da, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:41:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6d6bc394-a30d-4e7a-8d87-274bacd55ec5 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.850s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG nova.compute.manager [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing instance network info cache due to event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG nova.network.neutron [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG nova.network.neutron [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated VIF entry in instance network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG nova.network.neutron [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:41:23 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-88bc05b8-7a56-4d7e-8cd0-b63fbeca7964 req-d98df2df-9a02-443b-8294-183099adf829 service nova] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing instance network info cache due to event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated VIF entry in instance network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:41:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-cf73e085-4f44-43a0-a685-55c60185b025 req-adf58a48-b400-4e67-99ae-e9d06074e1c3 service nova] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:41:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:41:34 user nova-compute[75438]: INFO nova.compute.claims [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Claim successful on node user
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:41:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.policy [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ff6a04bdbde4baa8a9361a33fe822e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04bce2ed85774546969a3751c866b287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:41:34 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Creating image(s)
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:34 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.190s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk 1073741824" returned: 0 in 0.052s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Successfully created port: e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Cannot resize image /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Ensure instance console log exists: /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Successfully updated port: e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.compute.manager [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing instance network info cache due to event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance network_info: |[{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Start _get_guest_xml network_info=[{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:41:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:41:36 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-541620754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-541620754',id=48,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDpZI/R9Z1xssdQBpGNVrZuSOgFSAI/Av/ZWiRVvSBjVj7Pi8giMUuPxyxzEOBRnU2zFEqLmXomm2msBF/xjXfN///oj2sdyyaUu2QwW+LTjsVW/bAlegYMclmi10h7GA==',key_name='tempest-keypair-1727374062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-upk4k0xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=584cd9c8-0814-48cd-b609-f2263b051ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'pci_devices' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:41:36 user nova-compute[75438]:   <uuid>584cd9c8-0814-48cd-b609-f2263b051ba9</uuid>
Nov 09 02:41:36 user nova-compute[75438]:   <name>instance-00000030</name>
Nov 09 02:41:36 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:41:36 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:41:36 user nova-compute[75438]:   <metadata>
Nov 09 02:41:36 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:41:36 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:41:36 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-541620754</nova:name>
Nov 09 02:41:36 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:41:36</nova:creationTime>
Nov 09 02:41:36 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:41:36 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:41:36 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:41:36 user nova-compute[75438]:       <nova:owner>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:user uuid="2ff6a04bdbde4baa8a9361a33fe822e9">tempest-AttachVolumeShelveTestJSON-1323114484-project-member</nova:user>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:project uuid="04bce2ed85774546969a3751c866b287">tempest-AttachVolumeShelveTestJSON-1323114484</nova:project>
Nov 09 02:41:36 user nova-compute[75438]:       </nova:owner>
Nov 09 02:41:36 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:41:36 user nova-compute[75438]:       <nova:ports>
Nov 09 02:41:36 user nova-compute[75438]:         <nova:port uuid="e6c2decb-77b6-4a61-acd1-4d251bce4a08">
Nov 09 02:41:36 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 02:41:36 user nova-compute[75438]:         </nova:port>
Nov 09 02:41:36 user nova-compute[75438]:       </nova:ports>
Nov 09 02:41:36 user nova-compute[75438]:     </nova:instance>
Nov 09 02:41:36 user nova-compute[75438]:   </metadata>
Nov 09 02:41:36 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:41:36 user nova-compute[75438]:     <system>
Nov 09 02:41:36 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:41:36 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:41:36 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:41:36 user nova-compute[75438]:       <entry name="serial">584cd9c8-0814-48cd-b609-f2263b051ba9</entry>
Nov 09 02:41:36 user nova-compute[75438]:       <entry name="uuid">584cd9c8-0814-48cd-b609-f2263b051ba9</entry>
Nov 09 02:41:36 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:41:36 user nova-compute[75438]:     </system>
Nov 09 02:41:36 user nova-compute[75438]:   </sysinfo>
Nov 09 02:41:36 user nova-compute[75438]:   <os>
Nov 09 02:41:36 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:41:36 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:41:36 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:41:36 user nova-compute[75438]:   </os>
Nov 09 02:41:36 user nova-compute[75438]:   <features>
Nov 09 02:41:36 user nova-compute[75438]:     <acpi/>
Nov 09 02:41:36 user nova-compute[75438]:     <apic/>
Nov 09 02:41:36 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:41:36 user nova-compute[75438]:   </features>
Nov 09 02:41:36 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:41:36 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:41:36 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:41:36 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:41:36 user nova-compute[75438]:   </clock>
Nov 09 02:41:36 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:41:36 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:41:36 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:41:36 user nova-compute[75438]:   </cpu>
Nov 09 02:41:36 user nova-compute[75438]:   <devices>
Nov 09 02:41:36 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:41:36 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:41:36 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk"/>
Nov 09 02:41:36 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:41:36 user nova-compute[75438]:     </disk>
Nov 09 02:41:36 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:41:36 user nova-compute[75438]:       <mac address="fa:16:3e:b5:01:c3"/>
Nov 09 02:41:36 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:41:36 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:41:36 user nova-compute[75438]:       <target dev="tape6c2decb-77"/>
Nov 09 02:41:36 user nova-compute[75438]:     </interface>
Nov 09 02:41:36 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:41:36 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/console.log" append="off"/>
Nov 09 02:41:36 user nova-compute[75438]:     </serial>
Nov 09 02:41:36 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:41:36 user nova-compute[75438]:     <video>
Nov 09 02:41:36 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:41:36 user nova-compute[75438]:     </video>
Nov 09 02:41:36 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:41:36 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:41:36 user nova-compute[75438]:     </rng>
Nov 09 02:41:36 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:41:36 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:41:36 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:41:36 user nova-compute[75438]:     </memballoon>
Nov 09 02:41:36 user nova-compute[75438]:   </devices>
Nov 09 02:41:36 user nova-compute[75438]: </domain>
Nov 09 02:41:36 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-541620754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-541620754',id=48,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDpZI/R9Z1xssdQBpGNVrZuSOgFSAI/Av/ZWiRVvSBjVj7Pi8giMUuPxyxzEOBRnU2zFEqLmXomm2msBF/xjXfN///oj2sdyyaUu2QwW+LTjsVW/bAlegYMclmi10h7GA==',key_name='tempest-keypair-1727374062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-upk4k0xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=584cd9c8-0814-48cd-b609-f2263b051ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG os_vif [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00b1768b-2870-51a5-89e4-e84998347abf', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c2decb-77, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6c2decb-77, col_values=(('qos', UUID('280a53b5-42db-4f07-8fc5-17b36a081987')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6c2decb-77, col_values=(('external_ids', {'iface-id': 'e6c2decb-77b6-4a61-acd1-4d251bce4a08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:01:c3', 'vm-uuid': '584cd9c8-0814-48cd-b609-f2263b051ba9'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:36 user nova-compute[75438]: INFO os_vif [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77')
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No VIF found with MAC fa:16:3e:b5:01:c3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updated VIF entry in instance network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG nova.network.neutron [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:41:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ac23c56f-8926-40bd-b672-0de7db168d36 req-9b68282c-9f92-4c27-a931-fd09bed3efa6 service nova] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:37 user nova-compute[75438]: INFO nova.compute.manager [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Rebooting instance
Nov 09 02:41:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:41:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-b8b0ea78-0850-4385-ae91-94acc4d1a31a req-c73b935e-c889-4f11-9133-a1c674241a0a service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b8b0ea78-0850-4385-ae91-94acc4d1a31a req-c73b935e-c889-4f11-9133-a1c674241a0a service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b8b0ea78-0850-4385-ae91-94acc4d1a31a req-c73b935e-c889-4f11-9133-a1c674241a0a service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b8b0ea78-0850-4385-ae91-94acc4d1a31a req-c73b935e-c889-4f11-9133-a1c674241a0a service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-b8b0ea78-0850-4385-ae91-94acc4d1a31a req-c73b935e-c889-4f11-9133-a1c674241a0a service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:41:38 user nova-compute[75438]: WARNING nova.compute.manager [req-b8b0ea78-0850-4385-ae91-94acc4d1a31a req-c73b935e-c889-4f11-9133-a1c674241a0a service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state building and task_state spawning.
Nov 09 02:41:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-8809109b-e7fd-42d6-bbb9-aeebb434660a req-54e95ae9-4704-4f24-ae85-4045cd3b32c4 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-unplugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8809109b-e7fd-42d6-bbb9-aeebb434660a req-54e95ae9-4704-4f24-ae85-4045cd3b32c4 service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8809109b-e7fd-42d6-bbb9-aeebb434660a req-54e95ae9-4704-4f24-ae85-4045cd3b32c4 service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8809109b-e7fd-42d6-bbb9-aeebb434660a req-54e95ae9-4704-4f24-ae85-4045cd3b32c4 service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:38 user nova-compute[75438]: DEBUG nova.compute.manager [req-8809109b-e7fd-42d6-bbb9-aeebb434660a req-54e95ae9-4704-4f24-ae85-4045cd3b32c4 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-unplugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:41:38 user nova-compute[75438]: WARNING nova.compute.manager [req-8809109b-e7fd-42d6-bbb9-aeebb434660a req-54e95ae9-4704-4f24-ae85-4045cd3b32c4 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-unplugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state active and task_state reboot_started_hard.
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:39 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance destroyed successfully.
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'resources' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-958492107',display_name='tempest-TestMinimumBasicScenario-server-958492107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-958492107',id=46,image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY9+P8l9kEfebd1AbxvPZjIGbSKf9kfHZ/arhCYZWJF/T2u33irNbjdWF0ZIbnMUKh+3SnMfIjxhFepWEi3Ncn9CFZY6Z6RN9zXwMb+MHJvqP+Y07Ro86xVPh0ufhmwYQ==',key_name='tempest-TestMinimumBasicScenario-408172966',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-gzz6mrm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:41:38Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=6ed560b3-f605-414a-8838-dda51ec9e9fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21cb98af-ad, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82ab530e-0d97-467d-8af4-0137cee880fc) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:39 user nova-compute[75438]: INFO os_vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad')
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:41:39 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613a7cf-b918-4935-b6fa-3991e51d096a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:41:39 user nova-compute[75438]: No targets found.
Nov 09 02:41:39 user nova-compute[75438]: iSNS:
Nov 09 02:41:39 user nova-compute[75438]: No targets found.
Nov 09 02:41:39 user nova-compute[75438]: STATIC:
Nov 09 02:41:39 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b
Nov 09 02:41:39 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:41:39 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:41:39 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe
Nov 09 02:41:39 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:41:39 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:41:39 user nova-compute[75438]: FIRMWARE:
Nov 09 02:41:39 user nova-compute[75438]: No targets found.
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:41:39 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:41:39 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68c7a65-fdcb-41f2-8537-0f592e41a4f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd84b64-b69d-426a-845c-29be64cf7186]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:39 user nova-compute[75438]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:39 user nova-compute[75438]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba044aeef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0490f1a-a68d-4c4e-9047-df5d04eb4904]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8778074f-50bc-4f95-ae7d-c792cbffac79]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcde53fb-57b5-4be4-8f5f-1ad43bcac65c]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd3d6ec-e804-48c8-8675-d1cdc4578e39]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6810d526-ff57-4c34-be5f-b7ca9f8477c4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c5ebb-5cb9-4c80-b01e-0272ee855b82]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]
Nov 09 02:41:39 user nova-compute[75438]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a0e5d2-9e17-4d5e-a84a-772c965bb3d4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== disconnect_volume: return (296ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Start _get_guest_xml network_info=[{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bfe6a85-28a9-4d95-93bd-9c60f515fb45,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': '8bfe6a85-28a9-4d95-93bd-9c60f515fb45'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '9a3dc31b-8a66-4532-b861-cfd3100e6a11', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6ed560b3-f605-414a-8838-dda51ec9e9fd', 'attached_at': '', 'detached_at': '', 'volume_id': '555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'serial': '555cac18-51d9-4cb9-a142-6a01f3fe3ffe'}, 'volume_type': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:41:39 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:41:39 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8bfe6a85-28a9-4d95-93bd-9c60f515fb45,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.objects.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Object Instance<6ed560b3-f605-414a-8838-dda51ec9e9fd> lazy-loaded attributes: resources,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:41:39 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:41:39 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:41:39 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da3ee59-0d07-492f-9f79-67ec5cd9f76f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:41:39 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe9ddd-3de7-4334-94a5-e2516652a6db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe] added
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731e8dd-64fb-4605-9663-bfaf3fc4baf6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[364fdf5f-9d2d-4c6d-9baa-84bdc30bc21d]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFmteKVb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFmteKVb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac20bb9b-312f-4b87-846e-911bd7b5345e]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFmteKVb'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29d6e8a-dc8f-477f-b999-6e3470989067]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[050b2580-a204-4bbb-a395-6428c9f307b8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcb8c99-0790-4b3e-b411-f63ef5e387ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]
Nov 09 02:41:39 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74f4255-60b6-4ada-9a3b-6f638112d221]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3a71b8-4d06-4d9a-b258-1a3e23c512f4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:39 user nova-compute[75438]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:41:39 user nova-compute[75438]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:41:39 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14fbb0f-a79f-4743-9c5d-0978320be1a2]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:41:39 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:41:40 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance spawned successfully.
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:41:40 user nova-compute[75438]: INFO nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-a3845638-aa50-4912-b184-c92e61178a96 req-c851eb94-14a8-48ee-b28d-1e25b982b288 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a3845638-aa50-4912-b184-c92e61178a96 req-c851eb94-14a8-48ee-b28d-1e25b982b288 service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a3845638-aa50-4912-b184-c92e61178a96 req-c851eb94-14a8-48ee-b28d-1e25b982b288 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a3845638-aa50-4912-b184-c92e61178a96 req-c851eb94-14a8-48ee-b28d-1e25b982b288 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-a3845638-aa50-4912-b184-c92e61178a96 req-c851eb94-14a8-48ee-b28d-1e25b982b288 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:41:40 user nova-compute[75438]: WARNING nova.compute.manager [req-a3845638-aa50-4912-b184-c92e61178a96 req-c851eb94-14a8-48ee-b28d-1e25b982b288 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state building and task_state spawning.
Nov 09 02:41:40 user nova-compute[75438]: INFO nova.compute.manager [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Took 5.84 seconds to build instance.
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5bb6d4bd-3ad8-4fc3-a951-815a477ec1a6 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.952s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-260e9f68-9c78-44fd-8341-00c46369bbf8 req-81b64255-2a78-4b50-87be-a3a180c9741e service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-260e9f68-9c78-44fd-8341-00c46369bbf8 req-81b64255-2a78-4b50-87be-a3a180c9741e service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-260e9f68-9c78-44fd-8341-00c46369bbf8 req-81b64255-2a78-4b50-87be-a3a180c9741e service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-260e9f68-9c78-44fd-8341-00c46369bbf8 req-81b64255-2a78-4b50-87be-a3a180c9741e service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-260e9f68-9c78-44fd-8341-00c46369bbf8 req-81b64255-2a78-4b50-87be-a3a180c9741e service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:41:40 user nova-compute[75438]: WARNING nova.compute.manager [req-260e9f68-9c78-44fd-8341-00c46369bbf8 req-81b64255-2a78-4b50-87be-a3a180c9741e service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state active and task_state reboot_started_hard.
Nov 09 02:41:40 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26134376463393733', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134376463393733', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-958492107',display_name='tempest-TestMinimumBasicScenario-server-958492107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-958492107',id=46,image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY9+P8l9kEfebd1AbxvPZjIGbSKf9kfHZ/arhCYZWJF/T2u33irNbjdWF0ZIbnMUKh+3SnMfIjxhFepWEi3Ncn9CFZY6Z6RN9zXwMb+MHJvqP+Y07Ro86xVPh0ufhmwYQ==',key_name='tempest-TestMinimumBasicScenario-408172966',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-gzz6mrm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:41:38Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=6ed560b3-f605-414a-8838-dda51ec9e9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.objects.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Object Instance<6ed560b3-f605-414a-8838-dda51ec9e9fd> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:41:40 user nova-compute[75438]:   <uuid>6ed560b3-f605-414a-8838-dda51ec9e9fd</uuid>
Nov 09 02:41:40 user nova-compute[75438]:   <name>instance-0000002e</name>
Nov 09 02:41:40 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:41:40 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:41:40 user nova-compute[75438]:   <metadata>
Nov 09 02:41:40 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:41:40 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:41:40 user nova-compute[75438]:       <nova:name>tempest-TestMinimumBasicScenario-server-958492107</nova:name>
Nov 09 02:41:40 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:41:39</nova:creationTime>
Nov 09 02:41:40 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:41:40 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:41:40 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:41:40 user nova-compute[75438]:       <nova:owner>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:user uuid="6c48f9b9f842438086c55914bfde5e66">tempest-TestMinimumBasicScenario-1532902727-project-member</nova:user>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:project uuid="a1b08c7740da46a8ab8c3856b854ea12">tempest-TestMinimumBasicScenario-1532902727</nova:project>
Nov 09 02:41:40 user nova-compute[75438]:       </nova:owner>
Nov 09 02:41:40 user nova-compute[75438]:       <nova:root type="image" uuid="8bfe6a85-28a9-4d95-93bd-9c60f515fb45"/>
Nov 09 02:41:40 user nova-compute[75438]:       <nova:ports>
Nov 09 02:41:40 user nova-compute[75438]:         <nova:port uuid="21cb98af-ade9-4e82-99ef-dcd73488ea23">
Nov 09 02:41:40 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 09 02:41:40 user nova-compute[75438]:         </nova:port>
Nov 09 02:41:40 user nova-compute[75438]:       </nova:ports>
Nov 09 02:41:40 user nova-compute[75438]:     </nova:instance>
Nov 09 02:41:40 user nova-compute[75438]:   </metadata>
Nov 09 02:41:40 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:41:40 user nova-compute[75438]:     <system>
Nov 09 02:41:40 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:41:40 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:41:40 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:41:40 user nova-compute[75438]:       <entry name="serial">6ed560b3-f605-414a-8838-dda51ec9e9fd</entry>
Nov 09 02:41:40 user nova-compute[75438]:       <entry name="uuid">6ed560b3-f605-414a-8838-dda51ec9e9fd</entry>
Nov 09 02:41:40 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:41:40 user nova-compute[75438]:     </system>
Nov 09 02:41:40 user nova-compute[75438]:   </sysinfo>
Nov 09 02:41:40 user nova-compute[75438]:   <os>
Nov 09 02:41:40 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:41:40 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:41:40 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:41:40 user nova-compute[75438]:   </os>
Nov 09 02:41:40 user nova-compute[75438]:   <features>
Nov 09 02:41:40 user nova-compute[75438]:     <acpi/>
Nov 09 02:41:40 user nova-compute[75438]:     <apic/>
Nov 09 02:41:40 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:41:40 user nova-compute[75438]:   </features>
Nov 09 02:41:40 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:41:40 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:41:40 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:41:40 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:41:40 user nova-compute[75438]:   </clock>
Nov 09 02:41:40 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:41:40 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:41:40 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:41:40 user nova-compute[75438]:   </cpu>
Nov 09 02:41:40 user nova-compute[75438]:   <devices>
Nov 09 02:41:40 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:41:40 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:41:40 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk"/>
Nov 09 02:41:40 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:41:40 user nova-compute[75438]:     </disk>
Nov 09 02:41:40 user nova-compute[75438]:     <disk type="block" device="disk">
Nov 09 02:41:40 user nova-compute[75438]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:41:40 user nova-compute[75438]:       <source dev="/dev/sdc"/>
Nov 09 02:41:40 user nova-compute[75438]:       <target dev="vdb" bus="virtio"/>
Nov 09 02:41:40 user nova-compute[75438]:       <serial>555cac18-51d9-4cb9-a142-6a01f3fe3ffe</serial>
Nov 09 02:41:40 user nova-compute[75438]:     </disk>
Nov 09 02:41:40 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:41:40 user nova-compute[75438]:       <mac address="fa:16:3e:e0:fd:da"/>
Nov 09 02:41:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:41:40 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:41:40 user nova-compute[75438]:       <target dev="tap21cb98af-ad"/>
Nov 09 02:41:40 user nova-compute[75438]:     </interface>
Nov 09 02:41:40 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:41:40 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/console.log" append="off"/>
Nov 09 02:41:40 user nova-compute[75438]:     </serial>
Nov 09 02:41:40 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:41:40 user nova-compute[75438]:     <video>
Nov 09 02:41:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:41:40 user nova-compute[75438]:     </video>
Nov 09 02:41:40 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:41:40 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:41:40 user nova-compute[75438]:     </rng>
Nov 09 02:41:40 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:41:40 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:41:40 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:41:40 user nova-compute[75438]:     </memballoon>
Nov 09 02:41:40 user nova-compute[75438]:   </devices>
Nov 09 02:41:40 user nova-compute[75438]: </domain>
Nov 09 02:41:40 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:41:40 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.objects.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Object Instance<6ed560b3-f605-414a-8838-dda51ec9e9fd> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49f18774236ba54e46b78990e87b4e1563b9b49b --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Cannot resize image /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.objects.instance [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'migration_context' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.objects.base [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Object Instance<6ed560b3-f605-414a-8838-dda51ec9e9fd> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-958492107',display_name='tempest-TestMinimumBasicScenario-server-958492107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-958492107',id=46,image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY9+P8l9kEfebd1AbxvPZjIGbSKf9kfHZ/arhCYZWJF/T2u33irNbjdWF0ZIbnMUKh+3SnMfIjxhFepWEi3Ncn9CFZY6Z6RN9zXwMb+MHJvqP+Y07Ro86xVPh0ufhmwYQ==',key_name='tempest-TestMinimumBasicScenario-408172966',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-gzz6mrm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:41:38Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=6ed560b3-f605-414a-8838-dda51ec9e9fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG os_vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6ace8f9-b523-59b3-a2ae-727c1742f0cb', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21cb98af-ad, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21cb98af-ad, col_values=(('qos', UUID('8cc8eaf7-d232-46a8-9bd5-e40e435f0c12')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21cb98af-ad, col_values=(('external_ids', {'iface-id': '21cb98af-ade9-4e82-99ef-dcd73488ea23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:fd:da', 'vm-uuid': '6ed560b3-f605-414a-8838-dda51ec9e9fd'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:41:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:41 user nova-compute[75438]: INFO os_vif [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad')
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-5ddca074-5948-4c6c-b84b-46d2b30f84a3 req-faebb72f-2707-4934-ad78-c8cbba299a9a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5ddca074-5948-4c6c-b84b-46d2b30f84a3 req-faebb72f-2707-4934-ad78-c8cbba299a9a service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5ddca074-5948-4c6c-b84b-46d2b30f84a3 req-faebb72f-2707-4934-ad78-c8cbba299a9a service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5ddca074-5948-4c6c-b84b-46d2b30f84a3 req-faebb72f-2707-4934-ad78-c8cbba299a9a service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-5ddca074-5948-4c6c-b84b-46d2b30f84a3 req-faebb72f-2707-4934-ad78-c8cbba299a9a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:41:43 user nova-compute[75438]: WARNING nova.compute.manager [req-5ddca074-5948-4c6c-b84b-46d2b30f84a3 req-faebb72f-2707-4934-ad78-c8cbba299a9a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state active and task_state reboot_started_hard.
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:41:45 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance rebooted successfully.
Nov 09 02:41:45 user nova-compute[75438]: DEBUG nova.compute.manager [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:41:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-c2c6f114-081b-4a72-9fb8-73361fd385bf req-4989a1a6-c89e-4799-8c78-c3a55e1f066d service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:41:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c2c6f114-081b-4a72-9fb8-73361fd385bf req-4989a1a6-c89e-4799-8c78-c3a55e1f066d service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c2c6f114-081b-4a72-9fb8-73361fd385bf req-4989a1a6-c89e-4799-8c78-c3a55e1f066d service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c2c6f114-081b-4a72-9fb8-73361fd385bf req-4989a1a6-c89e-4799-8c78-c3a55e1f066d service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:45 user nova-compute[75438]: DEBUG nova.compute.manager [req-c2c6f114-081b-4a72-9fb8-73361fd385bf req-4989a1a6-c89e-4799-8c78-c3a55e1f066d service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:41:45 user nova-compute[75438]: WARNING nova.compute.manager [req-c2c6f114-081b-4a72-9fb8-73361fd385bf req-4989a1a6-c89e-4799-8c78-c3a55e1f066d service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state active and task_state reboot_started_hard.
Nov 09 02:41:45 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-3965ea4b-06cc-4e2d-9a00-b8e3e85435af tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.765s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:48 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:48 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:41:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:41:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:41:48 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:41:49 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:41:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:41:49 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:41:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:41:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:41:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:41:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:41:55 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:41:55 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=24.853187561035156GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6ed560b3-f605-414a-8838-dda51ec9e9fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 584cd9c8-0814-48cd-b609-f2263b051ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:41:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:41:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:41:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:41:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-changed-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG nova.compute.manager [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Refreshing instance network info cache due to event network-changed-65d244fa-d424-42d3-9531-810994705c9e. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] Acquiring lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] Acquired lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:42:06 user nova-compute[75438]: DEBUG nova.network.neutron [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Refreshing network info cache for port 65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:07 user nova-compute[75438]: INFO nova.compute.manager [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Terminating instance
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-341504ce-f385-4017-9876-d78c0eef6af6 req-87218432-7566-4dbf-bf19-0fa02461e1ee service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-vif-unplugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-341504ce-f385-4017-9876-d78c0eef6af6 req-87218432-7566-4dbf-bf19-0fa02461e1ee service nova] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-341504ce-f385-4017-9876-d78c0eef6af6 req-87218432-7566-4dbf-bf19-0fa02461e1ee service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-341504ce-f385-4017-9876-d78c0eef6af6 req-87218432-7566-4dbf-bf19-0fa02461e1ee service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-341504ce-f385-4017-9876-d78c0eef6af6 req-87218432-7566-4dbf-bf19-0fa02461e1ee service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] No waiting events found dispatching network-vif-unplugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.compute.manager [req-341504ce-f385-4017-9876-d78c0eef6af6 req-87218432-7566-4dbf-bf19-0fa02461e1ee service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-vif-unplugged-65d244fa-d424-42d3-9531-810994705c9e for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.network.neutron [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updated VIF entry in instance network info cache for port 65d244fa-d424-42d3-9531-810994705c9e. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.network.neutron [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [{"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-114bc22a-fe27-4ff0-bf38-cf673d426096 req-57c3ec0f-264c-424a-82bd-a6ee3e6ae6ad service nova] Releasing lock "refresh_cache-d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:42:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Instance destroyed successfully.
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lazy-loading 'resources' on Instance uuid d439e4ed-0ea3-49fc-82bd-a3ccadb8101a {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476224391',display_name='tempest-TestVolumeBootPattern-server-476224391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476224391',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJL8W6Bu+Ili3F/l59VdF5BxDUdGIKohaIiZo1BvJN7z3hdwGhAh9FHdgqFAoZnTsvG6Cq1SghLE7CUNt4ZT5lQxIxgxGSYo+ITRjUeOiJDTFwQdo9hS68H9yuIi1aciQ==',key_name='tempest-TestVolumeBootPattern-560369462',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:37:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6c21c58de14dbda4534441cad48918',ramdisk_id='',reservation_id='r-8i4b4qlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1394927917',owner_user_name='tempest-TestVolumeBootPattern-1394927917-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:37:14Z,user_data=None,user_id='3b5297e15fd14f1395cb606e791c4202',uuid=d439e4ed-0ea3-49fc-82bd-a3ccadb8101a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converting VIF {"id": "65d244fa-d424-42d3-9531-810994705c9e", "address": "fa:16:3e:d9:01:7a", "network": {"id": "e3d09bf6-7d67-48a2-b958-350c488025d6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-467689312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6c21c58de14dbda4534441cad48918", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d244fa-d4", "ovs_interfaceid": "65d244fa-d424-42d3-9531-810994705c9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_vif [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d244fa-d4, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1b7615e-0da2-45b2-8cff-4eaa93787f82) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:07 user nova-compute[75438]: INFO os_vif [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:01:7a,bridge_name='br-int',has_traffic_filtering=True,id=65d244fa-d424-42d3-9531-810994705c9e,network=Network(e3d09bf6-7d67-48a2-b958-350c488025d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65d244fa-d4')
Nov 09 02:42:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZcTFHabB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:42:07 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20659d-ef7e-4bcb-9ff3-863eeb11ab97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:42:07 user nova-compute[75438]: No targets found.
Nov 09 02:42:07 user nova-compute[75438]: iSNS:
Nov 09 02:42:07 user nova-compute[75438]: No targets found.
Nov 09 02:42:07 user nova-compute[75438]: STATIC:
Nov 09 02:42:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b
Nov 09 02:42:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:42:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:42:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe
Nov 09 02:42:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:42:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:42:07 user nova-compute[75438]: FIRMWARE:
Nov 09 02:42:07 user nova-compute[75438]: No targets found.
Nov 09 02:42:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:42:07 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:42:07 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d6ad8-2344-47a6-80a7-41ccd896af04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1d306c-1bb1-44ea-acd0-30aad299b749]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:42:07 user nova-compute[75438]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:42:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b (non-flash)
Nov 09 02:42:07 user nova-compute[75438]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:42:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba2c1bbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f998c073-f08d-468b-a02d-5f1ea7c42b41]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[592af6f6-7631-424a-add8-f3b79832e78d]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f2a69-9edc-4ec7-b57c-6057236fcea3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:42:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a4b26c-195f-4c97-ab12-c32f09ba0183]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a9b0782a', '/dev/disk/by-id/scsi-26638333365383231', '/dev/disk/by-id/scsi-1SCST_BIOa9b0782a-f833e82116de8766') {{(pid=87049) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc874d-f2a2-4d89-a7e7-10d96a79dada]: (4, None) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6d18f2-cb62-4ab3-9115-082cfbe2fd78]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5dd07-628b-4611-9d58-451a7164ad4e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260]
Nov 09 02:42:08 user nova-compute[75438]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b, portal: 172.16.0.220,3260] successful.
Nov 09 02:42:08 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f1ba6c6-33d2-4a97-bf39-7c04ada2f79b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[60337afd-77eb-45e8-b3dd-7d536d7f3c45]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] <== disconnect_volume: return (302ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:42:08 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Deleting instance files /opt/stack/data/nova/instances/d439e4ed-0ea3-49fc-82bd-a3ccadb8101a_del
Nov 09 02:42:08 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Deletion of /opt/stack/data/nova/instances/d439e4ed-0ea3-49fc-82bd-a3ccadb8101a_del complete
Nov 09 02:42:08 user nova-compute[75438]: INFO nova.compute.manager [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 09 02:42:08 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:42:08 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:42:08 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Took 0.44 seconds to deallocate network for instance.
Nov 09 02:42:08 user nova-compute[75438]: DEBUG nova.compute.manager [req-e4f90bc5-c27a-4503-bf0e-a84826ec89ec req-8dee817d-44b3-41b9-86c7-3435bd85d01e service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-vif-deleted-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-aacf714f-2944-4575-8f58-cfdbba042f96 req-e0eead28-c820-4db4-9cbe-870e6cf2fdc7 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received event network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-aacf714f-2944-4575-8f58-cfdbba042f96 req-e0eead28-c820-4db4-9cbe-870e6cf2fdc7 service nova] Acquiring lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-aacf714f-2944-4575-8f58-cfdbba042f96 req-e0eead28-c820-4db4-9cbe-870e6cf2fdc7 service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-aacf714f-2944-4575-8f58-cfdbba042f96 req-e0eead28-c820-4db4-9cbe-870e6cf2fdc7 service nova] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG nova.compute.manager [req-aacf714f-2944-4575-8f58-cfdbba042f96 req-e0eead28-c820-4db4-9cbe-870e6cf2fdc7 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] No waiting events found dispatching network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:42:09 user nova-compute[75438]: WARNING nova.compute.manager [req-aacf714f-2944-4575-8f58-cfdbba042f96 req-e0eead28-c820-4db4-9cbe-870e6cf2fdc7 service nova] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Received unexpected event network-vif-plugged-65d244fa-d424-42d3-9531-810994705c9e for instance with vm_state active and task_state deleting.
Nov 09 02:42:09 user nova-compute[75438]: INFO nova.compute.manager [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] [instance: d439e4ed-0ea3-49fc-82bd-a3ccadb8101a] Took 0.87 seconds to detach 1 volumes for instance.
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:09 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Deleted allocations for instance d439e4ed-0ea3-49fc-82bd-a3ccadb8101a
Nov 09 02:42:09 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4699da7a-a8cd-4ecd-a7cf-0f22a6f8aa51 tempest-TestVolumeBootPattern-1394927917 tempest-TestVolumeBootPattern-1394927917-project-member] Lock "d439e4ed-0ea3-49fc-82bd-a3ccadb8101a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.890s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:42:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:42:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:42:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:42:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:42:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:42:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:42:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:53 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:42:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:42:54 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:42:55 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:42:55 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=24.82439422607422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6ed560b3-f605-414a-8838-dda51ec9e9fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 584cd9c8-0814-48cd-b609-f2263b051ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:42:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:42:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:42:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:42:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:43:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:43:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:43:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:43:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:09 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG nova.compute.manager [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing instance network info cache due to event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updated VIF entry in instance network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG nova.network.neutron [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:43:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7d00e9ac-c2be-4e3e-af12-72e1da2c82a7 req-0d7827c7-b659-42f0-a1cb-0fb44ecf8609 service nova] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:43:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:43:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing instance network info cache due to event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:43:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:43:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:43:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated VIF entry in instance network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-fa74c629-6516-4a1e-b7d6-6665e604b0f0 req-c119035b-72d2-4148-9cca-eec2154be6c0 service nova] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing instance network info cache due to event network-changed-21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.network.neutron [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Refreshing network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:30 user nova-compute[75438]: INFO nova.compute.manager [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Detaching volume 555cac18-51d9-4cb9-a142-6a01f3fe3ffe
Nov 09 02:43:30 user nova-compute[75438]: INFO nova.virt.block_device [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Attempting to driver detach volume 555cac18-51d9-4cb9-a142-6a01f3fe3ffe from mountpoint /dev/vdb
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Attempting to detach device vdb from instance 6ed560b3-f605-414a-8838-dda51ec9e9fd from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:43:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:43:30 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:43:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:43:30 user nova-compute[75438]:   <serial>555cac18-51d9-4cb9-a142-6a01f3fe3ffe</serial>
Nov 09 02:43:30 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:43:30 user nova-compute[75438]: </disk>
Nov 09 02:43:30 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:43:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully detached device vdb from instance 6ed560b3-f605-414a-8838-dda51ec9e9fd from the persistent domain config.
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ed560b3-f605-414a-8838-dda51ec9e9fd from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:43:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:43:30 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:43:30 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:43:30 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:43:30 user nova-compute[75438]:   <serial>555cac18-51d9-4cb9-a142-6a01f3fe3ffe</serial>
Nov 09 02:43:30 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 09 02:43:30 user nova-compute[75438]: </disk>
Nov 09 02:43:30 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:43:31 user nova-compute[75438]: DEBUG nova.network.neutron [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated VIF entry in instance network info cache for port 21cb98af-ade9-4e82-99ef-dcd73488ea23. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:43:31 user nova-compute[75438]: DEBUG nova.network.neutron [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:43:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-069ca74c-aad4-4089-bcde-4e575a371fff req-fc1e803c-996a-46bc-af9d-e655b2cd0f1a service nova] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:43:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:32 user nova-compute[75438]: INFO nova.compute.manager [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Shelving
Nov 09 02:43:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-16bd674b-520d-4a51-b281-945560ab70e1 req-14b6d009-7229-40c5-abf3-f9b7d4555b37 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-unplugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-16bd674b-520d-4a51-b281-945560ab70e1 req-14b6d009-7229-40c5-abf3-f9b7d4555b37 service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-16bd674b-520d-4a51-b281-945560ab70e1 req-14b6d009-7229-40c5-abf3-f9b7d4555b37 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-16bd674b-520d-4a51-b281-945560ab70e1 req-14b6d009-7229-40c5-abf3-f9b7d4555b37 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-16bd674b-520d-4a51-b281-945560ab70e1 req-14b6d009-7229-40c5-abf3-f9b7d4555b37 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-unplugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:43:32 user nova-compute[75438]: WARNING nova.compute.manager [req-16bd674b-520d-4a51-b281-945560ab70e1 req-14b6d009-7229-40c5-abf3-f9b7d4555b37 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-unplugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state active and task_state shelving.
Nov 09 02:43:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance destroyed successfully.
Nov 09 02:43:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Beginning cold snapshot process
Nov 09 02:43:33 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:43:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk /opt/stack/data/nova/instances/snapshots/tmp_ftf9qcz/f526aaf1ea994911821a7df3160a8035 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:33 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk /opt/stack/data/nova/instances/snapshots/tmp_ftf9qcz/f526aaf1ea994911821a7df3160a8035" returned: 0 in 0.576s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:33 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Snapshot extracted, beginning image upload
Nov 09 02:43:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-b994b923-e9ed-4b23-a24b-d3bec836f9a7 req-664ded96-8a1c-4976-833a-43f5c141cba2 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:43:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b994b923-e9ed-4b23-a24b-d3bec836f9a7 req-664ded96-8a1c-4976-833a-43f5c141cba2 service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b994b923-e9ed-4b23-a24b-d3bec836f9a7 req-664ded96-8a1c-4976-833a-43f5c141cba2 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b994b923-e9ed-4b23-a24b-d3bec836f9a7 req-664ded96-8a1c-4976-833a-43f5c141cba2 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-b994b923-e9ed-4b23-a24b-d3bec836f9a7 req-664ded96-8a1c-4976-833a-43f5c141cba2 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:43:34 user nova-compute[75438]: WARNING nova.compute.manager [req-b994b923-e9ed-4b23-a24b-d3bec836f9a7 req-664ded96-8a1c-4976-833a-43f5c141cba2 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state active and task_state shelving_image_uploading.
Nov 09 02:43:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Snapshot image upload complete
Nov 09 02:43:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:43:36 user nova-compute[75438]: INFO nova.compute.manager [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Shelve offloading
Nov 09 02:43:36 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance destroyed successfully.
Nov 09 02:43:36 user nova-compute[75438]: DEBUG nova.compute.manager [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:43:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:43:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:43:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:43:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:36 user nova-compute[75438]: DEBUG nova.network.neutron [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:43:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:43:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance destroyed successfully.
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'resources' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-541620754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-541620754',id=48,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDpZI/R9Z1xssdQBpGNVrZuSOgFSAI/Av/ZWiRVvSBjVj7Pi8giMUuPxyxzEOBRnU2zFEqLmXomm2msBF/xjXfN///oj2sdyyaUu2QwW+LTjsVW/bAlegYMclmi10h7GA==',key_name='tempest-keypair-1727374062',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:41:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-upk4k0xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member',shelved_at='2023-11-09T02:43:36.191544',shelved_host='user',shelved_image_id='07a47144-d60f-4b8f-aa6d-da4c27ed327c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=584cd9c8-0814-48cd-b609-f2263b051ba9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG os_vif [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c2decb-77, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=280a53b5-42db-4f07-8fc5-17b36a081987) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:43:37 user nova-compute[75438]: INFO os_vif [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77')
Nov 09 02:43:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Deleting instance files /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9_del
Nov 09 02:43:37 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Deletion of /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9_del complete
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing instance network info cache due to event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.network.neutron [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:43:37 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Deleted allocations for instance 584cd9c8-0814-48cd-b609-f2263b051ba9
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.objects.instance [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'numa_topology' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.objects.base [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<584cd9c8-0814-48cd-b609-f2263b051ba9> lazy-loaded attributes: resources,numa_topology {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-4979f1fd-5614-4508-918f-72b9c7de75c2 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.453s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.network.neutron [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updated VIF entry in instance network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG nova.network.neutron [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape6c2decb-77", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:43:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d01edf9f-fa2a-40af-9e82-e3b6685c7bb8 req-d62448d1-7a4e-4177-ad5b-24b3b7ae8569 service nova] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:43:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:43:50 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [{"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6ed560b3-f605-414a-8838-dda51ec9e9fd" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:43:51 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ed560b3-f605-414a-8838-dda51ec9e9fd is timed out.
Nov 09 02:43:51 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully detached device vdb from instance 6ed560b3-f605-414a-8838-dda51ec9e9fd from the live domain config.
Nov 09 02:43:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFmteKVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:43:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf704272-70f1-4c4e-ad1a-4b990e2f6532]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:43:51 user nova-compute[75438]: No targets found.
Nov 09 02:43:51 user nova-compute[75438]: iSNS:
Nov 09 02:43:51 user nova-compute[75438]: No targets found.
Nov 09 02:43:51 user nova-compute[75438]: STATIC:
Nov 09 02:43:51 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe
Nov 09 02:43:51 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:43:51 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:43:51 user nova-compute[75438]: FIRMWARE:
Nov 09 02:43:51 user nova-compute[75438]: No targets found.
Nov 09 02:43:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:43:51 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:43:51 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b00f3-522a-4468-afb5-ebe3e49a3ebf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[42757856-ae20-41d6-b4d8-3d2fad1f54d2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:43:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe (non-flash)
Nov 09 02:43:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba241a4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb0130-f81e-4727-b7f0-c73b452b0256]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43316d1-be0b-4919-b873-245d19e43d61]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac14f3-253d-418f-aeb7-9c5720a7b11b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156f574-b76a-4e81-ae26-648830e56620]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda7e653-88a2-46bc-91ad-13a51d173d5a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a692c-21a0-406a-829a-769b30294272]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260]
Nov 09 02:43:51 user nova-compute[75438]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe, portal: 172.16.0.220,3260] successful.
Nov 09 02:43:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:555cac18-51d9-4cb9-a142-6a01f3fe3ffe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a08f3e-301b-4d79-9c60-2ea554717f01]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== disconnect_volume: return (301ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:43:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:43:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'flavor' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:43:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-b73f70f1-d50c-4825-9bde-d2ead307e454 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.058s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:55 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:43:55 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:43:56 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:43:56 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:43:56 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.80158233642578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6ed560b3-f605-414a-8838-dda51ec9e9fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:43:56 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:43:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:43:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:43:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:44:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:44:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:16 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:44:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:31 user nova-compute[75438]: INFO nova.compute.manager [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Terminating instance
Nov 09 02:44:31 user nova-compute[75438]: DEBUG nova.compute.manager [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-df2bb600-1a03-4886-bb76-4d2d70abd8d2 req-3dea12aa-3dbc-49b9-b154-995249acfde3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-unplugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-df2bb600-1a03-4886-bb76-4d2d70abd8d2 req-3dea12aa-3dbc-49b9-b154-995249acfde3 service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-df2bb600-1a03-4886-bb76-4d2d70abd8d2 req-3dea12aa-3dbc-49b9-b154-995249acfde3 service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-df2bb600-1a03-4886-bb76-4d2d70abd8d2 req-3dea12aa-3dbc-49b9-b154-995249acfde3 service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-df2bb600-1a03-4886-bb76-4d2d70abd8d2 req-3dea12aa-3dbc-49b9-b154-995249acfde3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-unplugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-df2bb600-1a03-4886-bb76-4d2d70abd8d2 req-3dea12aa-3dbc-49b9-b154-995249acfde3 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-unplugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Instance destroyed successfully.
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'resources' on Instance uuid 6ed560b3-f605-414a-8838-dda51ec9e9fd {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:38:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-958492107',display_name='tempest-TestMinimumBasicScenario-server-958492107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-958492107',id=46,image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJY9+P8l9kEfebd1AbxvPZjIGbSKf9kfHZ/arhCYZWJF/T2u33irNbjdWF0ZIbnMUKh+3SnMfIjxhFepWEi3Ncn9CFZY6Z6RN9zXwMb+MHJvqP+Y07Ro86xVPh0ufhmwYQ==',key_name='tempest-TestMinimumBasicScenario-408172966',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:38:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-gzz6mrm0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8bfe6a85-28a9-4d95-93bd-9c60f515fb45',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:41:45Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=6ed560b3-f605-414a-8838-dda51ec9e9fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "address": "fa:16:3e:e0:fd:da", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cb98af-ad", "ovs_interfaceid": "21cb98af-ade9-4e82-99ef-dcd73488ea23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG os_vif [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21cb98af-ad, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8cc8eaf7-d232-46a8-9bd5-e40e435f0c12) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:32 user nova-compute[75438]: INFO os_vif [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:fd:da,bridge_name='br-int',has_traffic_filtering=True,id=21cb98af-ade9-4e82-99ef-dcd73488ea23,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cb98af-ad')
Nov 09 02:44:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Deleting instance files /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd_del
Nov 09 02:44:32 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Deletion of /opt/stack/data/nova/instances/6ed560b3-f605-414a-8838-dda51ec9e9fd_del complete
Nov 09 02:44:32 user nova-compute[75438]: INFO nova.compute.manager [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 09 02:44:32 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:44:32 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:44:33 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:44:33 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Took 0.74 seconds to deallocate network for instance.
Nov 09 02:44:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:33 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:44:33 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:44:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:33 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Deleted allocations for instance 6ed560b3-f605-414a-8838-dda51ec9e9fd
Nov 09 02:44:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-9f2c1475-4935-421b-8172-e7aa8588d630 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:44:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] Acquiring lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:34 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] Lock "6ed560b3-f605-414a-8838-dda51ec9e9fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] No waiting events found dispatching network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:44:34 user nova-compute[75438]: WARNING nova.compute.manager [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received unexpected event network-vif-plugged-21cb98af-ade9-4e82-99ef-dcd73488ea23 for instance with vm_state deleted and task_state None.
Nov 09 02:44:34 user nova-compute[75438]: DEBUG nova.compute.manager [req-0d67de7d-067c-4206-8974-88e152493235 req-e40173cd-7ba1-4ac5-a451-ec636da07309 service nova] [instance: 6ed560b3-f605-414a-8838-dda51ec9e9fd] Received event network-vif-deleted-21cb98af-ade9-4e82-99ef-dcd73488ea23 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:44:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:44:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:44:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:56 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:44:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:56 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:44:57 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:44:57 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:44:57 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=24.828929901123047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:44:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:44:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:25 user nova-compute[75438]: INFO nova.compute.manager [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Unshelving
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'pci_requests' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.objects.instance [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'numa_topology' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:45:25 user nova-compute[75438]: INFO nova.compute.claims [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Claim successful on node user
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:25 user nova-compute[75438]: INFO nova.network.neutron [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating port e6c2decb-77b6-4a61-acd1-4d251bce4a08 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:45:25 user nova-compute[75438]: INFO nova.compute.claims [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Claim successful on node user
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.network.neutron [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:45:25 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:45:25 user nova-compute[75438]: DEBUG nova.policy [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c48f9b9f842438086c55914bfde5e66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b08c7740da46a8ab8c3856b854ea12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:45:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Creating image(s)
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "/opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "/opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "dbe7295c492ee844f68b29e52c389a0eaed520db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "dbe7295c492ee844f68b29e52c389a0eaed520db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.compute.manager [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing instance network info cache due to event network-changed-e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Successfully created port: 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.part --force-share --output=json" returned: 0 in 0.223s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.virt.images [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786 was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.part /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.network.neutron [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:45:26 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Creating image(s)
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.objects.instance [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'trusted_certs' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.part /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.converted" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.network.neutron [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Refreshing network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG nova.objects.base [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<584cd9c8-0814-48cd-b609-f2263b051ba9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "ab64c61366b9df9246020cf0af64af30293c66ec" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:26 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "ab64c61366b9df9246020cf0af64af30293c66ec" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:27 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.part --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:27 user nova-compute[75438]: DEBUG nova.network.neutron [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Successfully updated port: 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:45:27 user nova-compute[75438]: DEBUG nova.compute.manager [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-changed-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.compute.manager [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing instance network info cache due to event network-changed-79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db.converted --force-share --output=json" returned: 0 in 1.068s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "dbe7295c492ee844f68b29e52c389a0eaed520db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.950s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.images [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] 07a47144-d60f-4b8f-aa6d-da4c27ed327c was qcow2, converting to raw {{(pid=75438) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.privsep.utils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75438) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.part /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.converted {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "dbe7295c492ee844f68b29e52c389a0eaed520db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "dbe7295c492ee844f68b29e52c389a0eaed520db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ba430c1d-b432-4f5f-9f8a-8562998d81b7 req-c09c2fe6-9578-4a62-a1cc-5735651f3694 service nova] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db --force-share --output=json" returned: 0 in 0.219s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db,backing_fmt=raw /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updated VIF entry in instance network info cache for port e6c2decb-77b6-4a61-acd1-4d251bce4a08. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.part /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.converted" returned: 0 in 0.377s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.converted --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db,backing_fmt=raw /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk 1073741824" returned: 0 in 0.161s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c375ba34-bb02-46de-8d1c-62fe2af76be0 req-33bbf6b1-e506-4735-b65b-886669dd98ac service nova] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "dbe7295c492ee844f68b29e52c389a0eaed520db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "ab64c61366b9df9246020cf0af64af30293c66ec" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.714s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dbe7295c492ee844f68b29e52c389a0eaed520db --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "ab64c61366b9df9246020cf0af64af30293c66ec" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "ab64c61366b9df9246020cf0af64af30293c66ec" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.network.neutron [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Cannot resize image /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Ensure instance console log exists: /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance network_info: |[{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Start _get_guest_xml network_info=[{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T02:45:23Z,direct_url=<?>,disk_format='qcow2',id=b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786,min_disk=0,min_ram=0,name='tempest-scenario-img--2104718652',owner='a1b08c7740da46a8ab8c3856b854ea12',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T02:45:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:45:28 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:45:28 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T02:45:23Z,direct_url=<?>,disk_format='qcow2',id=b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786,min_disk=0,min_ram=0,name='tempest-scenario-img--2104718652',owner='a1b08c7740da46a8ab8c3856b854ea12',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T02:45:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:45:28 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-649150865',display_name='tempest-TestMinimumBasicScenario-server-649150865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-649150865',id=49,image_ref='b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJanlA5tvzs8f/DEGK9MNeVv5hxBYf18fA3E4JsecTJdCN7PQ3jaVMURDGjv0ZJaUCt/YQjol0WQGBG6FRW7vGAFHBHdwY9JXwCPaeuAB70ACu969YKowwYr4vN6BECb+Q==',key_name='tempest-TestMinimumBasicScenario-811610301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-iogm7kp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:45:26Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=8fb8c2b0-9525-4b70-b78e-0accf1857bca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.objects.instance [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:45:29 user nova-compute[75438]:   <uuid>8fb8c2b0-9525-4b70-b78e-0accf1857bca</uuid>
Nov 09 02:45:29 user nova-compute[75438]:   <name>instance-00000031</name>
Nov 09 02:45:29 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:45:29 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:45:29 user nova-compute[75438]:   <metadata>
Nov 09 02:45:29 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:45:29 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:45:29 user nova-compute[75438]:       <nova:name>tempest-TestMinimumBasicScenario-server-649150865</nova:name>
Nov 09 02:45:29 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:45:28</nova:creationTime>
Nov 09 02:45:29 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:45:29 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:45:29 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:45:29 user nova-compute[75438]:       <nova:owner>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:user uuid="6c48f9b9f842438086c55914bfde5e66">tempest-TestMinimumBasicScenario-1532902727-project-member</nova:user>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:project uuid="a1b08c7740da46a8ab8c3856b854ea12">tempest-TestMinimumBasicScenario-1532902727</nova:project>
Nov 09 02:45:29 user nova-compute[75438]:       </nova:owner>
Nov 09 02:45:29 user nova-compute[75438]:       <nova:root type="image" uuid="b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786"/>
Nov 09 02:45:29 user nova-compute[75438]:       <nova:ports>
Nov 09 02:45:29 user nova-compute[75438]:         <nova:port uuid="79d4e65f-e742-487c-a1b4-decad465013f">
Nov 09 02:45:29 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 02:45:29 user nova-compute[75438]:         </nova:port>
Nov 09 02:45:29 user nova-compute[75438]:       </nova:ports>
Nov 09 02:45:29 user nova-compute[75438]:     </nova:instance>
Nov 09 02:45:29 user nova-compute[75438]:   </metadata>
Nov 09 02:45:29 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:45:29 user nova-compute[75438]:     <system>
Nov 09 02:45:29 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:45:29 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:45:29 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:45:29 user nova-compute[75438]:       <entry name="serial">8fb8c2b0-9525-4b70-b78e-0accf1857bca</entry>
Nov 09 02:45:29 user nova-compute[75438]:       <entry name="uuid">8fb8c2b0-9525-4b70-b78e-0accf1857bca</entry>
Nov 09 02:45:29 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:45:29 user nova-compute[75438]:     </system>
Nov 09 02:45:29 user nova-compute[75438]:   </sysinfo>
Nov 09 02:45:29 user nova-compute[75438]:   <os>
Nov 09 02:45:29 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:45:29 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:45:29 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:45:29 user nova-compute[75438]:   </os>
Nov 09 02:45:29 user nova-compute[75438]:   <features>
Nov 09 02:45:29 user nova-compute[75438]:     <acpi/>
Nov 09 02:45:29 user nova-compute[75438]:     <apic/>
Nov 09 02:45:29 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:45:29 user nova-compute[75438]:   </features>
Nov 09 02:45:29 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:45:29 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:45:29 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:45:29 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:45:29 user nova-compute[75438]:   </clock>
Nov 09 02:45:29 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:45:29 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:45:29 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:45:29 user nova-compute[75438]:   </cpu>
Nov 09 02:45:29 user nova-compute[75438]:   <devices>
Nov 09 02:45:29 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:45:29 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:45:29 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk"/>
Nov 09 02:45:29 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:45:29 user nova-compute[75438]:     </disk>
Nov 09 02:45:29 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:45:29 user nova-compute[75438]:       <mac address="fa:16:3e:71:23:3b"/>
Nov 09 02:45:29 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:45:29 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:45:29 user nova-compute[75438]:       <target dev="tap79d4e65f-e7"/>
Nov 09 02:45:29 user nova-compute[75438]:     </interface>
Nov 09 02:45:29 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:45:29 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/console.log" append="off"/>
Nov 09 02:45:29 user nova-compute[75438]:     </serial>
Nov 09 02:45:29 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:45:29 user nova-compute[75438]:     <video>
Nov 09 02:45:29 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:45:29 user nova-compute[75438]:     </video>
Nov 09 02:45:29 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:45:29 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:45:29 user nova-compute[75438]:     </rng>
Nov 09 02:45:29 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:45:29 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:45:29 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:45:29 user nova-compute[75438]:     </memballoon>
Nov 09 02:45:29 user nova-compute[75438]:   </devices>
Nov 09 02:45:29 user nova-compute[75438]: </domain>
Nov 09 02:45:29 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-649150865',display_name='tempest-TestMinimumBasicScenario-server-649150865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-649150865',id=49,image_ref='b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJanlA5tvzs8f/DEGK9MNeVv5hxBYf18fA3E4JsecTJdCN7PQ3jaVMURDGjv0ZJaUCt/YQjol0WQGBG6FRW7vGAFHBHdwY9JXwCPaeuAB70ACu969YKowwYr4vN6BECb+Q==',key_name='tempest-TestMinimumBasicScenario-811610301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-iogm7kp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:45:26Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=8fb8c2b0-9525-4b70-b78e-0accf1857bca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG os_vif [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5aa7da47-0a11-5743-bd53-9ab90065fa62', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d4e65f-e7, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79d4e65f-e7, col_values=(('qos', UUID('2c4ae4c4-8415-4f90-ac52-3cd77b0b1cc8')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79d4e65f-e7, col_values=(('external_ids', {'iface-id': '79d4e65f-e742-487c-a1b4-decad465013f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:23:3b', 'vm-uuid': '8fb8c2b0-9525-4b70-b78e-0accf1857bca'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec,backing_fmt=raw /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:29 user nova-compute[75438]: INFO os_vif [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7')
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec,backing_fmt=raw /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk 1073741824" returned: 0 in 0.051s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "ab64c61366b9df9246020cf0af64af30293c66ec" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No VIF found with MAC fa:16:3e:71:23:3b, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ab64c61366b9df9246020cf0af64af30293c66ec --force-share --output=json" returned: 0 in 0.167s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.objects.instance [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'migration_context' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG nova.objects.base [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<584cd9c8-0814-48cd-b609-f2263b051ba9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:45:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Rebasing disk image.
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 -F raw /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-e8cae14a-8dbc-42b6-a3e6-9bb6d2e90957 req-5faec5ec-43b7-445a-8ed2-76daf555914e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e8cae14a-8dbc-42b6-a3e6-9bb6d2e90957 req-5faec5ec-43b7-445a-8ed2-76daf555914e service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e8cae14a-8dbc-42b6-a3e6-9bb6d2e90957 req-5faec5ec-43b7-445a-8ed2-76daf555914e service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e8cae14a-8dbc-42b6-a3e6-9bb6d2e90957 req-5faec5ec-43b7-445a-8ed2-76daf555914e service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:30 user nova-compute[75438]: DEBUG nova.compute.manager [req-e8cae14a-8dbc-42b6-a3e6-9bb6d2e90957 req-5faec5ec-43b7-445a-8ed2-76daf555914e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:45:30 user nova-compute[75438]: WARNING nova.compute.manager [req-e8cae14a-8dbc-42b6-a3e6-9bb6d2e90957 req-5faec5ec-43b7-445a-8ed2-76daf555914e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state building and task_state spawning.
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 -F raw /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk" returned: 0 in 2.131s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Ensure instance console log exists: /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Start _get_guest_xml network_info=[{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f58652d8250cc5894de91dc8b404c1bd',container_format='bare',created_at=2023-11-09T02:43:32Z,direct_url=<?>,disk_format='qcow2',id=07a47144-d60f-4b8f-aa6d-da4c27ed327c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-541620754-shelved',owner='04bce2ed85774546969a3751c866b287',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T02:43:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:45:31 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:45:31 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f58652d8250cc5894de91dc8b404c1bd',container_format='bare',created_at=2023-11-09T02:43:32Z,direct_url=<?>,disk_format='qcow2',id=07a47144-d60f-4b8f-aa6d-da4c27ed327c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-541620754-shelved',owner='04bce2ed85774546969a3751c866b287',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-09T02:43:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.objects.instance [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'vcpu_model' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.objects.base [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<584cd9c8-0814-48cd-b609-f2263b051ba9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-541620754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-541620754',id=48,image_ref='07a47144-d60f-4b8f-aa6d-da4c27ed327c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1727374062',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:41:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-upk4k0xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member',shelved_at='2023-11-09T02:43:36.191544',shelved_host='user',shelved_image_id='07a47144-d60f-4b8f-aa6d-da4c27ed327c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=584cd9c8-0814-48cd-b609-f2263b051ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.objects.instance [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'pci_devices' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.objects.base [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Object Instance<584cd9c8-0814-48cd-b609-f2263b051ba9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75438) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:45:31 user nova-compute[75438]:   <uuid>584cd9c8-0814-48cd-b609-f2263b051ba9</uuid>
Nov 09 02:45:31 user nova-compute[75438]:   <name>instance-00000030</name>
Nov 09 02:45:31 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:45:31 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:45:31 user nova-compute[75438]:   <metadata>
Nov 09 02:45:31 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:45:31 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:45:31 user nova-compute[75438]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-541620754</nova:name>
Nov 09 02:45:31 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:45:31</nova:creationTime>
Nov 09 02:45:31 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:45:31 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:45:31 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:45:31 user nova-compute[75438]:       <nova:owner>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:user uuid="2ff6a04bdbde4baa8a9361a33fe822e9">tempest-AttachVolumeShelveTestJSON-1323114484-project-member</nova:user>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:project uuid="04bce2ed85774546969a3751c866b287">tempest-AttachVolumeShelveTestJSON-1323114484</nova:project>
Nov 09 02:45:31 user nova-compute[75438]:       </nova:owner>
Nov 09 02:45:31 user nova-compute[75438]:       <nova:root type="image" uuid="07a47144-d60f-4b8f-aa6d-da4c27ed327c"/>
Nov 09 02:45:31 user nova-compute[75438]:       <nova:ports>
Nov 09 02:45:31 user nova-compute[75438]:         <nova:port uuid="e6c2decb-77b6-4a61-acd1-4d251bce4a08">
Nov 09 02:45:31 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 09 02:45:31 user nova-compute[75438]:         </nova:port>
Nov 09 02:45:31 user nova-compute[75438]:       </nova:ports>
Nov 09 02:45:31 user nova-compute[75438]:     </nova:instance>
Nov 09 02:45:31 user nova-compute[75438]:   </metadata>
Nov 09 02:45:31 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:45:31 user nova-compute[75438]:     <system>
Nov 09 02:45:31 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:45:31 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:45:31 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:45:31 user nova-compute[75438]:       <entry name="serial">584cd9c8-0814-48cd-b609-f2263b051ba9</entry>
Nov 09 02:45:31 user nova-compute[75438]:       <entry name="uuid">584cd9c8-0814-48cd-b609-f2263b051ba9</entry>
Nov 09 02:45:31 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:45:31 user nova-compute[75438]:     </system>
Nov 09 02:45:31 user nova-compute[75438]:   </sysinfo>
Nov 09 02:45:31 user nova-compute[75438]:   <os>
Nov 09 02:45:31 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:45:31 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:45:31 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:45:31 user nova-compute[75438]:   </os>
Nov 09 02:45:31 user nova-compute[75438]:   <features>
Nov 09 02:45:31 user nova-compute[75438]:     <acpi/>
Nov 09 02:45:31 user nova-compute[75438]:     <apic/>
Nov 09 02:45:31 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:45:31 user nova-compute[75438]:   </features>
Nov 09 02:45:31 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:45:31 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:45:31 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:45:31 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:45:31 user nova-compute[75438]:   </clock>
Nov 09 02:45:31 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:45:31 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:45:31 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:45:31 user nova-compute[75438]:   </cpu>
Nov 09 02:45:31 user nova-compute[75438]:   <devices>
Nov 09 02:45:31 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:45:31 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:45:31 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk"/>
Nov 09 02:45:31 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:45:31 user nova-compute[75438]:     </disk>
Nov 09 02:45:31 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:45:31 user nova-compute[75438]:       <mac address="fa:16:3e:b5:01:c3"/>
Nov 09 02:45:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:45:31 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:45:31 user nova-compute[75438]:       <target dev="tape6c2decb-77"/>
Nov 09 02:45:31 user nova-compute[75438]:     </interface>
Nov 09 02:45:31 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:45:31 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/console.log" append="off"/>
Nov 09 02:45:31 user nova-compute[75438]:     </serial>
Nov 09 02:45:31 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:45:31 user nova-compute[75438]:     <video>
Nov 09 02:45:31 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:45:31 user nova-compute[75438]:     </video>
Nov 09 02:45:31 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:45:31 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:45:31 user nova-compute[75438]:     </rng>
Nov 09 02:45:31 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:45:31 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:45:31 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:45:31 user nova-compute[75438]:     </memballoon>
Nov 09 02:45:31 user nova-compute[75438]:   </devices>
Nov 09 02:45:31 user nova-compute[75438]: </domain>
Nov 09 02:45:31 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-541620754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-541620754',id=48,image_ref='07a47144-d60f-4b8f-aa6d-da4c27ed327c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1727374062',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:41:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-upk4k0xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member',shelved_at='2023-11-09T02:43:36.191544',shelved_host='user',shelved_image_id='07a47144-d60f-4b8f-aa6d-da4c27ed327c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:45:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=584cd9c8-0814-48cd-b609-f2263b051ba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG os_vif [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00b1768b-2870-51a5-89e4-e84998347abf', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6c2decb-77, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6c2decb-77, col_values=(('qos', UUID('c40364c7-0b78-491a-b877-2d151a943557')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6c2decb-77, col_values=(('external_ids', {'iface-id': 'e6c2decb-77b6-4a61-acd1-4d251bce4a08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:01:c3', 'vm-uuid': '584cd9c8-0814-48cd-b609-f2263b051ba9'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:31 user nova-compute[75438]: INFO os_vif [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77')
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:45:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] No VIF found with MAC fa:16:3e:b5:01:c3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:45:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-dcbf77e4-bb5e-4798-9f3f-2d17cc67bf28 req-7f1f5cb3-468f-4646-bff3-f78009c22c05 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:45:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dcbf77e4-bb5e-4798-9f3f-2d17cc67bf28 req-7f1f5cb3-468f-4646-bff3-f78009c22c05 service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dcbf77e4-bb5e-4798-9f3f-2d17cc67bf28 req-7f1f5cb3-468f-4646-bff3-f78009c22c05 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dcbf77e4-bb5e-4798-9f3f-2d17cc67bf28 req-7f1f5cb3-468f-4646-bff3-f78009c22c05 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:32 user nova-compute[75438]: DEBUG nova.compute.manager [req-dcbf77e4-bb5e-4798-9f3f-2d17cc67bf28 req-7f1f5cb3-468f-4646-bff3-f78009c22c05 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:45:32 user nova-compute[75438]: WARNING nova.compute.manager [req-dcbf77e4-bb5e-4798-9f3f-2d17cc67bf28 req-7f1f5cb3-468f-4646-bff3-f78009c22c05 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state building and task_state spawning.
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:45:33 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance spawned successfully.
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:45:33 user nova-compute[75438]: INFO nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Took 7.07 seconds to spawn the instance on the hypervisor.
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:45:33 user nova-compute[75438]: INFO nova.compute.manager [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Took 7.59 seconds to build instance.
Nov 09 02:45:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-38991ba8-7880-404e-a5f0-261549a87db8 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.685s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-5b496200-a91c-43fe-b930-8d8c17bbd9a8 req-d654b324-e478-4bd8-806a-0beeadf597c4 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5b496200-a91c-43fe-b930-8d8c17bbd9a8 req-d654b324-e478-4bd8-806a-0beeadf597c4 service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5b496200-a91c-43fe-b930-8d8c17bbd9a8 req-d654b324-e478-4bd8-806a-0beeadf597c4 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5b496200-a91c-43fe-b930-8d8c17bbd9a8 req-d654b324-e478-4bd8-806a-0beeadf597c4 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-5b496200-a91c-43fe-b930-8d8c17bbd9a8 req-d654b324-e478-4bd8-806a-0beeadf597c4 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:45:33 user nova-compute[75438]: WARNING nova.compute.manager [req-5b496200-a91c-43fe-b930-8d8c17bbd9a8 req-d654b324-e478-4bd8-806a-0beeadf597c4 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 02:45:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-86563109-e9aa-4a5b-ae41-4b9ec1e7d2d2 req-ddf33e15-b7f1-491e-ba0e-1beafd81fd11 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:45:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-86563109-e9aa-4a5b-ae41-4b9ec1e7d2d2 req-ddf33e15-b7f1-491e-ba0e-1beafd81fd11 service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-86563109-e9aa-4a5b-ae41-4b9ec1e7d2d2 req-ddf33e15-b7f1-491e-ba0e-1beafd81fd11 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-86563109-e9aa-4a5b-ae41-4b9ec1e7d2d2 req-ddf33e15-b7f1-491e-ba0e-1beafd81fd11 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-86563109-e9aa-4a5b-ae41-4b9ec1e7d2d2 req-ddf33e15-b7f1-491e-ba0e-1beafd81fd11 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:45:35 user nova-compute[75438]: WARNING nova.compute.manager [req-86563109-e9aa-4a5b-ae41-4b9ec1e7d2d2 req-ddf33e15-b7f1-491e-ba0e-1beafd81fd11 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 09 02:45:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:45:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:45:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance spawned successfully.
Nov 09 02:45:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:45:36 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-504e52c3-d3fc-4e88-bf32-254299c64aaa tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.945s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:45:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:45:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:45:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:45:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:50 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:50 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:45:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:45:54 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:45:55 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:45:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:45:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:45:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:45:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:45:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:45:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:45:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:45:58 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:45:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:45:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:46:00 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:46:00 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=24.75296401977539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 584cd9c8-0814-48cd-b609-f2263b051ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:46:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:46:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:52 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:52 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:46:55 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:46:56 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:46:57 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [{"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:46:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-584cd9c8-0814-48cd-b609-f2263b051ba9" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:46:57 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:46:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:46:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:46:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:46:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:46:58 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:46:58 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:46:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:00 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:47:00 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=24.752079010009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 584cd9c8-0814-48cd-b609-f2263b051ba9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:47:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:47:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:47:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:15 user nova-compute[75438]: INFO nova.compute.manager [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Terminating instance
Nov 09 02:47:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-e13742cb-d304-4e38-a297-e09edb568264 req-ca2f8cb0-445f-4574-9865-2c82ae80d811 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-unplugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e13742cb-d304-4e38-a297-e09edb568264 req-ca2f8cb0-445f-4574-9865-2c82ae80d811 service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e13742cb-d304-4e38-a297-e09edb568264 req-ca2f8cb0-445f-4574-9865-2c82ae80d811 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e13742cb-d304-4e38-a297-e09edb568264 req-ca2f8cb0-445f-4574-9865-2c82ae80d811 service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-e13742cb-d304-4e38-a297-e09edb568264 req-ca2f8cb0-445f-4574-9865-2c82ae80d811 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-unplugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-e13742cb-d304-4e38-a297-e09edb568264 req-ca2f8cb0-445f-4574-9865-2c82ae80d811 service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-unplugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:47:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Instance destroyed successfully.
Nov 09 02:47:16 user nova-compute[75438]: DEBUG nova.objects.instance [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lazy-loading 'resources' on Instance uuid 584cd9c8-0814-48cd-b609-f2263b051ba9 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-09T02:41:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-541620754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-541620754',id=48,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDpZI/R9Z1xssdQBpGNVrZuSOgFSAI/Av/ZWiRVvSBjVj7Pi8giMUuPxyxzEOBRnU2zFEqLmXomm2msBF/xjXfN///oj2sdyyaUu2QwW+LTjsVW/bAlegYMclmi10h7GA==',key_name='tempest-keypair-1727374062',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:45:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04bce2ed85774546969a3751c866b287',ramdisk_id='',reservation_id='r-upk4k0xs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1323114484',owner_user_name='tempest-AttachVolumeShelveTestJSON-1323114484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ff6a04bdbde4baa8a9361a33fe822e9',uuid=584cd9c8-0814-48cd-b609-f2263b051ba9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converting VIF {"id": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "address": "fa:16:3e:b5:01:c3", "network": {"id": "a45e5a2c-f8b8-49a7-9207-828c797fd1ba", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1058931935-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04bce2ed85774546969a3751c866b287", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6c2decb-77", "ovs_interfaceid": "e6c2decb-77b6-4a61-acd1-4d251bce4a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG os_vif [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6c2decb-77, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c40364c7-0b78-491a-b877-2d151a943557) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:47:16 user nova-compute[75438]: INFO os_vif [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:01:c3,bridge_name='br-int',has_traffic_filtering=True,id=e6c2decb-77b6-4a61-acd1-4d251bce4a08,network=Network(a45e5a2c-f8b8-49a7-9207-828c797fd1ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6c2decb-77')
Nov 09 02:47:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Deleting instance files /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9_del
Nov 09 02:47:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Deletion of /opt/stack/data/nova/instances/584cd9c8-0814-48cd-b609-f2263b051ba9_del complete
Nov 09 02:47:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:16 user nova-compute[75438]: INFO nova.compute.manager [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 09 02:47:16 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:47:16 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:47:17 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Took 0.80 seconds to deallocate network for instance.
Nov 09 02:47:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c8163e9-8b09-42ea-ac68-bc91202e289e req-2f620728-1e33-4f30-8fdc-6acd5c5654ab service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-deleted-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:17 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Deleted allocations for instance 584cd9c8-0814-48cd-b609-f2263b051ba9
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-6a32cf6d-bfb2-4899-a2dd-2299d507d879 tempest-AttachVolumeShelveTestJSON-1323114484 tempest-AttachVolumeShelveTestJSON-1323114484-project-member] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-98393aac-f3c3-4541-9443-fad12d2f6b61 req-8096b6bf-853d-4765-a330-ec1dd0e9ee6a service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-98393aac-f3c3-4541-9443-fad12d2f6b61 req-8096b6bf-853d-4765-a330-ec1dd0e9ee6a service nova] Acquiring lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-98393aac-f3c3-4541-9443-fad12d2f6b61 req-8096b6bf-853d-4765-a330-ec1dd0e9ee6a service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-98393aac-f3c3-4541-9443-fad12d2f6b61 req-8096b6bf-853d-4765-a330-ec1dd0e9ee6a service nova] Lock "584cd9c8-0814-48cd-b609-f2263b051ba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-98393aac-f3c3-4541-9443-fad12d2f6b61 req-8096b6bf-853d-4765-a330-ec1dd0e9ee6a service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] No waiting events found dispatching network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:47:17 user nova-compute[75438]: WARNING nova.compute.manager [req-98393aac-f3c3-4541-9443-fad12d2f6b61 req-8096b6bf-853d-4765-a330-ec1dd0e9ee6a service nova] [instance: 584cd9c8-0814-48cd-b609-f2263b051ba9] Received unexpected event network-vif-plugged-e6c2decb-77b6-4a61-acd1-4d251bce4a08 for instance with vm_state deleted and task_state None.
Nov 09 02:47:19 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'flavor' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:22 user nova-compute[75438]: INFO nova.compute.manager [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Attaching volume 02df1510-96e4-4bff-ab27-6ffa6778beb7 to /dev/vdb
Nov 09 02:47:22 user nova-compute[75438]: DEBUG os_brick.utils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b51962-a0c8-4278-8d1e-d5a75f820fb9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6c2a58-28d9-41b8-bb85-bac2c1d5109c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[141d248f-b935-4502-a7e3-ae983b61ce20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[00317729-2e5c-42e0-b99f-16385ffbb575]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:47:22 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:47:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1742144d-ea43-4aad-845b-6dbcb9963cb8]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG os_brick.utils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:47:22 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating existing volume attachment record: 54bf46c9-4198-4a2f-898c-ad35d929af09 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:47:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:47:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEjsaftw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:47:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:47:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:47:44 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259b292-94d3-4aff-a2c5-2349021e7879]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:47:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d3d812-544c-48fb-ab9e-5d12700aa3d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7] added
Nov 09 02:47:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[961ce801-7101-4f19-a4f0-446dab111908]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c50d24-82a1-4462-af24-00f31c682c92]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEjsaftw {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XEjsaftw" returned: 0 in 0.025s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a6b64-fef4-4187-9d45-d0f3091c44c9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XEjsaftw'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c61407-1ba4-4b55-9249-fc158d5e0798]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e506cf59-f22e-40da-95b3-11cfef57db34]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:47:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:47:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:47:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:47:44 user nova-compute[75438]: 
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e7578-3d44-4f02-9536-a7359056830d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260]
Nov 09 02:47:44 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260] successful.
Nov 09 02:47:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6351b9a4-c2f8-4161-a511-90310b8a4c70]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdee47d4-21a5-4d28-b4f8-f6677373bfea]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 (non-flash)
Nov 09 02:47:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 (non-flash)
Nov 09 02:47:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c57dd-1c33-4b67-a4f3-dbfc6a56df69]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:47:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEjsaftw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:47:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:47:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23663663563316438', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:47:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663663563316438', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:47:45 user nova-compute[75438]: DEBUG nova.objects.instance [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'flavor' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:47:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:47:45 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:47:45 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:47:45 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:47:45 user nova-compute[75438]:   <serial>02df1510-96e4-4bff-ab27-6ffa6778beb7</serial>
Nov 09 02:47:45 user nova-compute[75438]: </disk>
Nov 09 02:47:45 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] No VIF found with MAC fa:16:3e:71:23:3b, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-8845654a-b26e-4e7a-8f46-fc253c9ecd7e tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.111s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-changed-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:48 user nova-compute[75438]: DEBUG nova.compute.manager [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing instance network info cache due to event network-changed-79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:47:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:47:48 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:47:48 user nova-compute[75438]: DEBUG nova.network.neutron [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:47:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated VIF entry in instance network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:47:49 user nova-compute[75438]: DEBUG nova.network.neutron [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:47:49 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-6ba14b92-39d8-484f-acd8-eb726f4af668 req-dbf9238d-d7d7-4570-8273-021c93dea40c service nova] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:47:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-changed-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:50 user nova-compute[75438]: DEBUG nova.compute.manager [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing instance network info cache due to event network-changed-79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:47:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:47:50 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:47:50 user nova-compute[75438]: DEBUG nova.network.neutron [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:51 user nova-compute[75438]: INFO nova.compute.manager [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Rebooting instance
Nov 09 02:47:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG nova.network.neutron [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated VIF entry in instance network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG nova.network.neutron [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-9677171d-0a1a-4517-adda-aceefe94574e req-da51e437-7eb1-4a2b-8ace-ab0c93b34f8e service nova] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG nova.network.neutron [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:47:51 user nova-compute[75438]: DEBUG nova.compute.manager [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:47:53 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:53 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-a16f3eed-14f7-4a76-84a9-d74ccd7742af req-9825dbda-9887-4868-b435-0909d1e23d18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-unplugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a16f3eed-14f7-4a76-84a9-d74ccd7742af req-9825dbda-9887-4868-b435-0909d1e23d18 service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a16f3eed-14f7-4a76-84a9-d74ccd7742af req-9825dbda-9887-4868-b435-0909d1e23d18 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a16f3eed-14f7-4a76-84a9-d74ccd7742af req-9825dbda-9887-4868-b435-0909d1e23d18 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG nova.compute.manager [req-a16f3eed-14f7-4a76-84a9-d74ccd7742af req-9825dbda-9887-4868-b435-0909d1e23d18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-unplugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:47:54 user nova-compute[75438]: WARNING nova.compute.manager [req-a16f3eed-14f7-4a76-84a9-d74ccd7742af req-9825dbda-9887-4868-b435-0909d1e23d18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-unplugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state active and task_state reboot_started.
Nov 09 02:47:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:54 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:55 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance shutdown successfully.
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-882f4b91-ba9c-4aa9-911b-82360415e4d7 req-5d5d75f8-ab12-4fa5-aa7f-2c09eb624f12 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-882f4b91-ba9c-4aa9-911b-82360415e4d7 req-5d5d75f8-ab12-4fa5-aa7f-2c09eb624f12 service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-882f4b91-ba9c-4aa9-911b-82360415e4d7 req-5d5d75f8-ab12-4fa5-aa7f-2c09eb624f12 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-882f4b91-ba9c-4aa9-911b-82360415e4d7 req-5d5d75f8-ab12-4fa5-aa7f-2c09eb624f12 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG nova.compute.manager [req-882f4b91-ba9c-4aa9-911b-82360415e4d7 req-5d5d75f8-ab12-4fa5-aa7f-2c09eb624f12 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:47:56 user nova-compute[75438]: WARNING nova.compute.manager [req-882f4b91-ba9c-4aa9-911b-82360415e4d7 req-5d5d75f8-ab12-4fa5-aa7f-2c09eb624f12 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state active and task_state reboot_started.
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:47:58 user nova-compute[75438]: WARNING nova.compute.manager [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state active and task_state reboot_started.
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:47:58 user nova-compute[75438]: WARNING nova.compute.manager [req-a4e0cb0d-b54b-42fd-aef2-3cbab59ee3f6 req-3ed9464d-c900-4306-b22b-d200e7ce6c18 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state active and task_state reboot_started.
Nov 09 02:47:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance running successfully.
Nov 09 02:47:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance soft rebooted successfully.
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-54b25210-f07d-42c0-aff4-dd52d869a8e0 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.395s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:47:58 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:47:59 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:48:00 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:48:00 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9029MB free_disk=24.778064727783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:48:00 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:48:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:48:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:48:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:48:04 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:48:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:48:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:48:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:48:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:48:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:48:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:48:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:48:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:48:54 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:48:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:48:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:48:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:48:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:48:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:49:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:49:01 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:02 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:49:02 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:49:02 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:49:02 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.767791748046875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:49:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:49:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:49:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:19 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:49:20 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:49:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:49:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:49:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:49:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:49:28 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:28 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Triggering sync for uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 09 02:49:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:28 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:49:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:29 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:49:29 user nova-compute[75438]: INFO nova.compute.claims [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Claim successful on node user
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.network.neutron [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:49:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.policy [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16b0bc5ef7234e0c90b7e3d044f0aee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86351f5b5ac64ab493c2a8db595fa7fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:49:30 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Creating image(s)
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "/opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "/opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "/opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.178s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk 1073741824" returned: 0 in 0.048s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:49:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Cannot resize image /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Ensure instance console log exists: /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Successfully created port: bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Successfully updated port: bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquired lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.network.neutron [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-changed-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG nova.compute.manager [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Refreshing instance network info cache due to event network-changed-bab3e8e0-dbd3-45a0-a678-e622d033ede8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:49:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] Acquiring lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.neutron [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating instance_info_cache with network_info: [{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Releasing lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Instance network_info: |[{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] Acquired lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Refreshing network info cache for port bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Start _get_guest_xml network_info=[{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:49:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:49:32 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-795228243',display_name='tempest-VolumesSnapshotTestJSON-instance-795228243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-795228243',id=50,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqyIktCeFTfI5JDShTj3AHVG+N/MaMYImf7mzadYOr+JVUtOCx8vZl7eHYqDhtAmtygkRCnlb7Rl/3bMYFpJuWvIFX9DsJdlfOQ5DIXlC5zfP/bEGubkixxVCs5ob6Q4w==',key_name='tempest-keypair-1927421240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86351f5b5ac64ab493c2a8db595fa7fa',ramdisk_id='',reservation_id='r-1226r14a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1997846373',owner_user_name='tempest-VolumesSnapshotTestJSON-1997846373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b0bc5ef7234e0c90b7e3d044f0aee2',uuid=911643f6-ef54-4b59-8a02-0b103927e508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converting VIF {"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.objects.instance [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'pci_devices' on Instance uuid 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:49:32 user nova-compute[75438]:   <uuid>911643f6-ef54-4b59-8a02-0b103927e508</uuid>
Nov 09 02:49:32 user nova-compute[75438]:   <name>instance-00000032</name>
Nov 09 02:49:32 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:49:32 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:49:32 user nova-compute[75438]:   <metadata>
Nov 09 02:49:32 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:49:32 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:49:32 user nova-compute[75438]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-795228243</nova:name>
Nov 09 02:49:32 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:49:32</nova:creationTime>
Nov 09 02:49:32 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:49:32 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:49:32 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:49:32 user nova-compute[75438]:       <nova:owner>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:user uuid="16b0bc5ef7234e0c90b7e3d044f0aee2">tempest-VolumesSnapshotTestJSON-1997846373-project-member</nova:user>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:project uuid="86351f5b5ac64ab493c2a8db595fa7fa">tempest-VolumesSnapshotTestJSON-1997846373</nova:project>
Nov 09 02:49:32 user nova-compute[75438]:       </nova:owner>
Nov 09 02:49:32 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:49:32 user nova-compute[75438]:       <nova:ports>
Nov 09 02:49:32 user nova-compute[75438]:         <nova:port uuid="bab3e8e0-dbd3-45a0-a678-e622d033ede8">
Nov 09 02:49:32 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 09 02:49:32 user nova-compute[75438]:         </nova:port>
Nov 09 02:49:32 user nova-compute[75438]:       </nova:ports>
Nov 09 02:49:32 user nova-compute[75438]:     </nova:instance>
Nov 09 02:49:32 user nova-compute[75438]:   </metadata>
Nov 09 02:49:32 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:49:32 user nova-compute[75438]:     <system>
Nov 09 02:49:32 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:49:32 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:49:32 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:49:32 user nova-compute[75438]:       <entry name="serial">911643f6-ef54-4b59-8a02-0b103927e508</entry>
Nov 09 02:49:32 user nova-compute[75438]:       <entry name="uuid">911643f6-ef54-4b59-8a02-0b103927e508</entry>
Nov 09 02:49:32 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:49:32 user nova-compute[75438]:     </system>
Nov 09 02:49:32 user nova-compute[75438]:   </sysinfo>
Nov 09 02:49:32 user nova-compute[75438]:   <os>
Nov 09 02:49:32 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:49:32 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:49:32 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:49:32 user nova-compute[75438]:   </os>
Nov 09 02:49:32 user nova-compute[75438]:   <features>
Nov 09 02:49:32 user nova-compute[75438]:     <acpi/>
Nov 09 02:49:32 user nova-compute[75438]:     <apic/>
Nov 09 02:49:32 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:49:32 user nova-compute[75438]:   </features>
Nov 09 02:49:32 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:49:32 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:49:32 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:49:32 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:49:32 user nova-compute[75438]:   </clock>
Nov 09 02:49:32 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:49:32 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:49:32 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:49:32 user nova-compute[75438]:   </cpu>
Nov 09 02:49:32 user nova-compute[75438]:   <devices>
Nov 09 02:49:32 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:49:32 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:49:32 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk"/>
Nov 09 02:49:32 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:49:32 user nova-compute[75438]:     </disk>
Nov 09 02:49:32 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:49:32 user nova-compute[75438]:       <mac address="fa:16:3e:c7:78:5e"/>
Nov 09 02:49:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:49:32 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:49:32 user nova-compute[75438]:       <target dev="tapbab3e8e0-db"/>
Nov 09 02:49:32 user nova-compute[75438]:     </interface>
Nov 09 02:49:32 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:49:32 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/console.log" append="off"/>
Nov 09 02:49:32 user nova-compute[75438]:     </serial>
Nov 09 02:49:32 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:49:32 user nova-compute[75438]:     <video>
Nov 09 02:49:32 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:49:32 user nova-compute[75438]:     </video>
Nov 09 02:49:32 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:49:32 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:49:32 user nova-compute[75438]:     </rng>
Nov 09 02:49:32 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:49:32 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:49:32 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:49:32 user nova-compute[75438]:     </memballoon>
Nov 09 02:49:32 user nova-compute[75438]:   </devices>
Nov 09 02:49:32 user nova-compute[75438]: </domain>
Nov 09 02:49:32 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-795228243',display_name='tempest-VolumesSnapshotTestJSON-instance-795228243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-795228243',id=50,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqyIktCeFTfI5JDShTj3AHVG+N/MaMYImf7mzadYOr+JVUtOCx8vZl7eHYqDhtAmtygkRCnlb7Rl/3bMYFpJuWvIFX9DsJdlfOQ5DIXlC5zfP/bEGubkixxVCs5ob6Q4w==',key_name='tempest-keypair-1927421240',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86351f5b5ac64ab493c2a8db595fa7fa',ramdisk_id='',reservation_id='r-1226r14a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1997846373',owner_user_name='tempest-VolumesSnapshotTestJSON-1997846373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b0bc5ef7234e0c90b7e3d044f0aee2',uuid=911643f6-ef54-4b59-8a02-0b103927e508,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converting VIF {"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG os_vif [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6a399db-36b4-5d50-ae4b-b7e0b29d05ba', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbab3e8e0-db, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbab3e8e0-db, col_values=(('qos', UUID('3f1c1a79-3559-4da2-aa6c-64c278c13827')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbab3e8e0-db, col_values=(('external_ids', {'iface-id': 'bab3e8e0-dbd3-45a0-a678-e622d033ede8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:78:5e', 'vm-uuid': '911643f6-ef54-4b59-8a02-0b103927e508'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:32 user nova-compute[75438]: INFO os_vif [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db')
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No VIF found with MAC fa:16:3e:c7:78:5e, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updated VIF entry in instance network info cache for port bab3e8e0-dbd3-45a0-a678-e622d033ede8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG nova.network.neutron [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating instance_info_cache with network_info: [{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:49:32 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7206815e-feba-41ad-b9f1-d090363c665e req-d808d71d-be3e-493f-84d3-3384a1f78652 service nova] Releasing lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-7092570c-a69a-4b6c-947a-cc07fceb220d req-776b97cb-5193-4876-9390-c0b0439af1ae service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7092570c-a69a-4b6c-947a-cc07fceb220d req-776b97cb-5193-4876-9390-c0b0439af1ae service nova] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7092570c-a69a-4b6c-947a-cc07fceb220d req-776b97cb-5193-4876-9390-c0b0439af1ae service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7092570c-a69a-4b6c-947a-cc07fceb220d req-776b97cb-5193-4876-9390-c0b0439af1ae service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:33 user nova-compute[75438]: DEBUG nova.compute.manager [req-7092570c-a69a-4b6c-947a-cc07fceb220d req-776b97cb-5193-4876-9390-c0b0439af1ae service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] No waiting events found dispatching network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:49:33 user nova-compute[75438]: WARNING nova.compute.manager [req-7092570c-a69a-4b6c-947a-cc07fceb220d req-776b97cb-5193-4876-9390-c0b0439af1ae service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received unexpected event network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 for instance with vm_state building and task_state spawning.
Nov 09 02:49:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:34 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:49:35 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Instance spawned successfully.
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:49:35 user nova-compute[75438]: INFO nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-ba621ed1-4685-4b21-81fc-25fd745b3fc2 req-4642c412-6b96-40e4-9bae-6158a098358c service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ba621ed1-4685-4b21-81fc-25fd745b3fc2 req-4642c412-6b96-40e4-9bae-6158a098358c service nova] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ba621ed1-4685-4b21-81fc-25fd745b3fc2 req-4642c412-6b96-40e4-9bae-6158a098358c service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-ba621ed1-4685-4b21-81fc-25fd745b3fc2 req-4642c412-6b96-40e4-9bae-6158a098358c service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:35 user nova-compute[75438]: DEBUG nova.compute.manager [req-ba621ed1-4685-4b21-81fc-25fd745b3fc2 req-4642c412-6b96-40e4-9bae-6158a098358c service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] No waiting events found dispatching network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:49:35 user nova-compute[75438]: WARNING nova.compute.manager [req-ba621ed1-4685-4b21-81fc-25fd745b3fc2 req-4642c412-6b96-40e4-9bae-6158a098358c service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received unexpected event network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 for instance with vm_state building and task_state spawning.
Nov 09 02:49:35 user nova-compute[75438]: INFO nova.compute.manager [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Took 5.99 seconds to build instance.
Nov 09 02:49:35 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-004f6703-a0fd-47a5-b9ac-f4b966111676 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.076s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:49:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-changed-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:49:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing instance network info cache due to event network-changed-79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:49:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:49:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:49:42 user nova-compute[75438]: DEBUG nova.network.neutron [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.network.neutron [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated VIF entry in instance network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.network.neutron [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-37b9e4db-2807-476b-a3d7-45b46d2f5eab req-d1052cfc-f43d-43e6-ab0b-a8e2cdb80e83 service nova] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-changed-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.compute.manager [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing instance network info cache due to event network-changed-79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.network.neutron [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Refreshing network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:49:43 user nova-compute[75438]: INFO nova.compute.manager [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Detaching volume 02df1510-96e4-4bff-ab27-6ffa6778beb7
Nov 09 02:49:43 user nova-compute[75438]: INFO nova.virt.block_device [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Attempting to driver detach volume 02df1510-96e4-4bff-ab27-6ffa6778beb7 from mountpoint /dev/vdb
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Attempting to detach device vdb from instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:49:43 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:49:43 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:49:43 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:49:43 user nova-compute[75438]:   <serial>02df1510-96e4-4bff-ab27-6ffa6778beb7</serial>
Nov 09 02:49:43 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:49:43 user nova-compute[75438]: </disk>
Nov 09 02:49:43 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:49:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully detached device vdb from instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca from the persistent domain config.
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:49:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:49:43 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:49:43 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:49:43 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:49:43 user nova-compute[75438]:   <serial>02df1510-96e4-4bff-ab27-6ffa6778beb7</serial>
Nov 09 02:49:43 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:49:43 user nova-compute[75438]: </disk>
Nov 09 02:49:43 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:49:44 user nova-compute[75438]: DEBUG nova.network.neutron [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated VIF entry in instance network info cache for port 79d4e65f-e742-487c-a1b4-decad465013f. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:49:44 user nova-compute[75438]: DEBUG nova.network.neutron [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:49:44 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5087b7b7-3cbf-408b-91eb-635a38da4d24 req-3d530db6-9570-4354-b5c9-527ebd6eb150 service nova] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:49:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:49:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:49:56 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:49:56 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:49:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:50:01 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:50:02 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [{"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:50:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-8fb8c2b0-9525-4b70-b78e-0accf1857bca" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:50:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:50:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:03 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:50:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca is timed out.
Nov 09 02:50:04 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully detached device vdb from instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca from the live domain config.
Nov 09 02:50:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XEjsaftw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:50:04 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0a40e0-01a4-458a-809a-bc2103a82c50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:50:04 user nova-compute[75438]: No targets found.
Nov 09 02:50:04 user nova-compute[75438]: iSNS:
Nov 09 02:50:04 user nova-compute[75438]: No targets found.
Nov 09 02:50:04 user nova-compute[75438]: STATIC:
Nov 09 02:50:04 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7
Nov 09 02:50:04 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:50:04 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:50:04 user nova-compute[75438]: FIRMWARE:
Nov 09 02:50:04 user nova-compute[75438]: No targets found.
Nov 09 02:50:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:50:04 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:50:04 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee585e1-5078-478a-a887-c2f6626169b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[899faf87-6a3e-4b6d-87e0-7fd21641f181]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 (non-flash)
Nov 09 02:50:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 (non-flash)
Nov 09 02:50:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba0444c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a908a4-4987-4f42-a5d2-6eba2fc30f72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f3fa01-c0c9-467b-ad85-48ad21f3c9db]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5117a78e-4883-4b80-87f7-92a2780c6096]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8719d97d-e3e7-4eee-9fb6-8444a1b69f93]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf978fe-ad6f-4ff7-ac75-1a88203d1e78]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[990a5f0e-397e-4f81-830c-7f7f5f812a37]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260]
Nov 09 02:50:04 user nova-compute[75438]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7, portal: 172.16.0.220,3260] successful.
Nov 09 02:50:04 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02df1510-96e4-4bff-ab27-6ffa6778beb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a781a8b8-a576-4d4a-95b0-fb74326aa379]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] <== disconnect_volume: return (332ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:50:04 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:50:05 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:50:05 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=24.73745346069336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 911643f6-ef54-4b59-8a02-0b103927e508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG nova.objects.instance [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'flavor' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:50:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-1d3e3784-53a2-457d-b45f-ab56c4e22c86 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:07 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:12 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:50:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:17 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:22 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:27 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:32 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:47 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:52 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:55 user nova-compute[75438]: INFO nova.compute.manager [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Terminating instance
Nov 09 02:50:55 user nova-compute[75438]: DEBUG nova.compute.manager [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-e54507b9-30d5-4dad-b90a-62f3d2133e68 req-a232e0ec-b080-4960-9c3e-c8ca7c0a180a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-unplugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e54507b9-30d5-4dad-b90a-62f3d2133e68 req-a232e0ec-b080-4960-9c3e-c8ca7c0a180a service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e54507b9-30d5-4dad-b90a-62f3d2133e68 req-a232e0ec-b080-4960-9c3e-c8ca7c0a180a service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-e54507b9-30d5-4dad-b90a-62f3d2133e68 req-a232e0ec-b080-4960-9c3e-c8ca7c0a180a service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-e54507b9-30d5-4dad-b90a-62f3d2133e68 req-a232e0ec-b080-4960-9c3e-c8ca7c0a180a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-unplugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:50:55 user nova-compute[75438]: DEBUG nova.compute.manager [req-e54507b9-30d5-4dad-b90a-62f3d2133e68 req-a232e0ec-b080-4960-9c3e-c8ca7c0a180a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-unplugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Instance destroyed successfully.
Nov 09 02:50:56 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lazy-loading 'resources' on Instance uuid 8fb8c2b0-9525-4b70-b78e-0accf1857bca {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:45:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-649150865',display_name='tempest-TestMinimumBasicScenario-server-649150865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-649150865',id=49,image_ref='b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJanlA5tvzs8f/DEGK9MNeVv5hxBYf18fA3E4JsecTJdCN7PQ3jaVMURDGjv0ZJaUCt/YQjol0WQGBG6FRW7vGAFHBHdwY9JXwCPaeuAB70ACu969YKowwYr4vN6BECb+Q==',key_name='tempest-TestMinimumBasicScenario-811610301',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:45:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1b08c7740da46a8ab8c3856b854ea12',ramdisk_id='',reservation_id='r-iogm7kp3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b73a2d4e-4acc-4b82-97b5-2e5ffc9f6786',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1532902727',owner_user_name='tempest-TestMinimumBasicScenario-1532902727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:47:59Z,user_data=None,user_id='6c48f9b9f842438086c55914bfde5e66',uuid=8fb8c2b0-9525-4b70-b78e-0accf1857bca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converting VIF {"id": "79d4e65f-e742-487c-a1b4-decad465013f", "address": "fa:16:3e:71:23:3b", "network": {"id": "57e088fb-c74d-446d-a856-d33496563dc5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2081366289-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1b08c7740da46a8ab8c3856b854ea12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d4e65f-e7", "ovs_interfaceid": "79d4e65f-e742-487c-a1b4-decad465013f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG os_vif [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d4e65f-e7, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c4ae4c4-8415-4f90-ac52-3cd77b0b1cc8) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:50:56 user nova-compute[75438]: INFO os_vif [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:23:3b,bridge_name='br-int',has_traffic_filtering=True,id=79d4e65f-e742-487c-a1b4-decad465013f,network=Network(57e088fb-c74d-446d-a856-d33496563dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d4e65f-e7')
Nov 09 02:50:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Deleting instance files /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca_del
Nov 09 02:50:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Deletion of /opt/stack/data/nova/instances/8fb8c2b0-9525-4b70-b78e-0accf1857bca_del complete
Nov 09 02:50:56 user nova-compute[75438]: INFO nova.compute.manager [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 09 02:50:56 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:50:56 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:50:57 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Took 0.63 seconds to deallocate network for instance.
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:57 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Deleted allocations for instance 8fb8c2b0-9525-4b70-b78e-0accf1857bca
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bf3891e1-da96-4168-88fb-b511fa148f18 tempest-TestMinimumBasicScenario-1532902727 tempest-TestMinimumBasicScenario-1532902727-project-member] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] Acquiring lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] Lock "8fb8c2b0-9525-4b70-b78e-0accf1857bca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] No waiting events found dispatching network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:50:57 user nova-compute[75438]: WARNING nova.compute.manager [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received unexpected event network-vif-plugged-79d4e65f-e742-487c-a1b4-decad465013f for instance with vm_state deleted and task_state None.
Nov 09 02:50:57 user nova-compute[75438]: DEBUG nova.compute.manager [req-c8266419-8a05-4f57-815e-ca388e25371a req-630703e6-fae2-4aa2-8140-ba080c5a8e5a service nova] [instance: 8fb8c2b0-9525-4b70-b78e-0accf1857bca] Received event network-vif-deleted-79d4e65f-e742-487c-a1b4-decad465013f {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:51:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:51:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:51:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:51:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:51:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating instance_info_cache with network_info: [{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:51:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:51:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:51:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:51:05 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:06 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:51:06 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.764602661132812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 911643f6-ef54-4b59-8a02-0b103927e508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:51:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:51:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:51:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-changed-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:51:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Refreshing instance network info cache due to event network-changed-bab3e8e0-dbd3-45a0-a678-e622d033ede8. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:51:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] Acquiring lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:51:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] Acquired lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:51:20 user nova-compute[75438]: DEBUG nova.network.neutron [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Refreshing network info cache for port bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:51:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:21 user nova-compute[75438]: DEBUG nova.network.neutron [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updated VIF entry in instance network info cache for port bab3e8e0-dbd3-45a0-a678-e622d033ede8. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:51:21 user nova-compute[75438]: DEBUG nova.network.neutron [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating instance_info_cache with network_info: [{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:51:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-dc4fd3f0-701b-4ef8-b2ef-74cad299c623 req-b3c89405-88dc-4d2e-9dbf-d40e5d91382b service nova] Releasing lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:51:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG nova.objects.instance [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'flavor' on Instance uuid 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:51:22 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Ignoring supplied device name: /dev/vdb
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:51:22 user nova-compute[75438]: INFO nova.compute.manager [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Attaching volume 46b1bf67-c215-4474-bb59-0bcff38916fc to /dev/vdb
Nov 09 02:51:22 user nova-compute[75438]: DEBUG os_brick.utils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdb56bf-6acf-41bf-b9f5-e4bdf1ad1c28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2be980-acea-4a38-bb4c-2ddb7711b56b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb1a48-133f-4281-9f39-24c0819045a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de77455-6c1f-4130-80c7-7f3051676cbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:51:22 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:51:22 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af0707-1361-4f70-a1d4-4080add74cc7]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG os_brick.utils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:51:22 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating existing volume attachment record: 918cf43a-9612-47dc-bbba-98d6aca32d78 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:51:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:26 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGQZDIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:51:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:51:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:51:44 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8678d11-660d-4d35-ac25-152d179c0903]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:51:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01a7046-7bea-4c70-be5c-b4609185766c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc] added
Nov 09 02:51:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21567bf-cd8c-4d9c-86b4-95961d2401c4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7f363c-bb3c-400e-85fe-1baee2947bf7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvGQZDIV {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvGQZDIV" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08f975a-0b18-4da0-bd67-23f77e70c2ab]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvGQZDIV'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3e595e-56d1-4849-8e66-b68c2a165e03]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34ba66-7267-4808-8adf-00a840c12a65]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:51:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:51:44 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:51:44 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:51:44 user nova-compute[75438]: 
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f925e8-ca2f-4626-8f43-c011b5524ef9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260]
Nov 09 02:51:44 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260] successful.
Nov 09 02:51:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37bf7a1-f8d7-4d9a-8ff1-8330ae744fe4]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a011f40-8621-4dd4-962a-3434fae84e3f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc (non-flash)
Nov 09 02:51:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc (non-flash)
Nov 09 02:51:44 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7182e67b-e3b0-4ec9-88f6-83f0a1fd1fa6]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:51:44 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGQZDIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23962363332373230', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363332373230', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG nova.objects.instance [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'flavor' on Instance uuid 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:51:45 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:51:45 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:51:45 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:51:45 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:51:45 user nova-compute[75438]:   <serial>46b1bf67-c215-4474-bb59-0bcff38916fc</serial>
Nov 09 02:51:45 user nova-compute[75438]: </disk>
Nov 09 02:51:45 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:51:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:51:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:51:46 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No VIF found with MAC fa:16:3e:c7:78:5e, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:51:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-481056bb-dbf7-4809-b186-38108a7f196a tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.641s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:51:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:51:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:51 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:56 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:51:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:51:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:51:59 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:52:01 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:52:02 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating instance_info_cache with network_info: [{"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:52:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-911643f6-ef54-4b59-8a02-0b103927e508" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:52:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:52:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:04 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:06 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:52:07 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:52:07 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.794200897216797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 911643f6-ef54-4b59-8a02-0b103927e508 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:52:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:52:11 user nova-compute[75438]: INFO nova.compute.claims [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Claim successful on node user
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.network.neutron [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:52:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.policy [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fe26a3f4ffd4a019d4ffb1709479d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad6e635ed030414f82235c8eb20083f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:52:11 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Creating image(s)
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "/opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "/opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "/opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.209s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk 1073741824" returned: 0 in 0.053s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.208s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG nova.network.neutron [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Successfully created port: fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Cannot resize image /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Ensure instance console log exists: /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Successfully updated port: fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquired lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-changed-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.compute.manager [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Refreshing instance network info cache due to event network-changed-fea745cd-a2de-498c-9fd7-532d217e4939. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] Acquiring lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Releasing lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Instance network_info: |[{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] Acquired lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Refreshing network info cache for port fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Start _get_guest_xml network_info=[{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:52:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:52:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1912706093',display_name='tempest-TestServerVolumeAttachmentScenario-server-1912706093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1912706093',id=51,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20v9EGy5rp7X9hkCP7J9+9jDTH2KaBNEgFPXr0ewRuU1xUIDtY0+Ej50Xxg0QM0MuZ1uCPeiUftShdi5i1HbUweTZuMwRn2WtUqLP6BHMJHYkYRp2rA7FqK+2e/dyNdQ==',key_name='tempest-keypair-236378161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad6e635ed030414f82235c8eb20083f2',ramdisk_id='',reservation_id='r-cfbmk76k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1402567886',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1402567886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fe26a3f4ffd4a019d4ffb1709479d79',uuid=6993f0e2-206d-49af-a77a-a9f39dcf5e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Converting VIF {"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.objects.instance [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'pci_devices' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:52:13 user nova-compute[75438]:   <uuid>6993f0e2-206d-49af-a77a-a9f39dcf5e38</uuid>
Nov 09 02:52:13 user nova-compute[75438]:   <name>instance-00000033</name>
Nov 09 02:52:13 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:52:13 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:52:13 user nova-compute[75438]:   <metadata>
Nov 09 02:52:13 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:52:13 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:52:13 user nova-compute[75438]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1912706093</nova:name>
Nov 09 02:52:13 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:52:13</nova:creationTime>
Nov 09 02:52:13 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:52:13 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:52:13 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:52:13 user nova-compute[75438]:       <nova:owner>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:user uuid="6fe26a3f4ffd4a019d4ffb1709479d79">tempest-TestServerVolumeAttachmentScenario-1402567886-project-member</nova:user>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:project uuid="ad6e635ed030414f82235c8eb20083f2">tempest-TestServerVolumeAttachmentScenario-1402567886</nova:project>
Nov 09 02:52:13 user nova-compute[75438]:       </nova:owner>
Nov 09 02:52:13 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:52:13 user nova-compute[75438]:       <nova:ports>
Nov 09 02:52:13 user nova-compute[75438]:         <nova:port uuid="fea745cd-a2de-498c-9fd7-532d217e4939">
Nov 09 02:52:13 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 09 02:52:13 user nova-compute[75438]:         </nova:port>
Nov 09 02:52:13 user nova-compute[75438]:       </nova:ports>
Nov 09 02:52:13 user nova-compute[75438]:     </nova:instance>
Nov 09 02:52:13 user nova-compute[75438]:   </metadata>
Nov 09 02:52:13 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:52:13 user nova-compute[75438]:     <system>
Nov 09 02:52:13 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:52:13 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:52:13 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:52:13 user nova-compute[75438]:       <entry name="serial">6993f0e2-206d-49af-a77a-a9f39dcf5e38</entry>
Nov 09 02:52:13 user nova-compute[75438]:       <entry name="uuid">6993f0e2-206d-49af-a77a-a9f39dcf5e38</entry>
Nov 09 02:52:13 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:52:13 user nova-compute[75438]:     </system>
Nov 09 02:52:13 user nova-compute[75438]:   </sysinfo>
Nov 09 02:52:13 user nova-compute[75438]:   <os>
Nov 09 02:52:13 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:52:13 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:52:13 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:52:13 user nova-compute[75438]:   </os>
Nov 09 02:52:13 user nova-compute[75438]:   <features>
Nov 09 02:52:13 user nova-compute[75438]:     <acpi/>
Nov 09 02:52:13 user nova-compute[75438]:     <apic/>
Nov 09 02:52:13 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:52:13 user nova-compute[75438]:   </features>
Nov 09 02:52:13 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:52:13 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:52:13 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:52:13 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:52:13 user nova-compute[75438]:   </clock>
Nov 09 02:52:13 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:52:13 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:52:13 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:52:13 user nova-compute[75438]:   </cpu>
Nov 09 02:52:13 user nova-compute[75438]:   <devices>
Nov 09 02:52:13 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:52:13 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:52:13 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk"/>
Nov 09 02:52:13 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:52:13 user nova-compute[75438]:     </disk>
Nov 09 02:52:13 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:52:13 user nova-compute[75438]:       <mac address="fa:16:3e:c5:73:18"/>
Nov 09 02:52:13 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:52:13 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:52:13 user nova-compute[75438]:       <target dev="tapfea745cd-a2"/>
Nov 09 02:52:13 user nova-compute[75438]:     </interface>
Nov 09 02:52:13 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:52:13 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/console.log" append="off"/>
Nov 09 02:52:13 user nova-compute[75438]:     </serial>
Nov 09 02:52:13 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:52:13 user nova-compute[75438]:     <video>
Nov 09 02:52:13 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:52:13 user nova-compute[75438]:     </video>
Nov 09 02:52:13 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:52:13 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:52:13 user nova-compute[75438]:     </rng>
Nov 09 02:52:13 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:52:13 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:52:13 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:52:13 user nova-compute[75438]:     </memballoon>
Nov 09 02:52:13 user nova-compute[75438]:   </devices>
Nov 09 02:52:13 user nova-compute[75438]: </domain>
Nov 09 02:52:13 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1912706093',display_name='tempest-TestServerVolumeAttachmentScenario-server-1912706093',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1912706093',id=51,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20v9EGy5rp7X9hkCP7J9+9jDTH2KaBNEgFPXr0ewRuU1xUIDtY0+Ej50Xxg0QM0MuZ1uCPeiUftShdi5i1HbUweTZuMwRn2WtUqLP6BHMJHYkYRp2rA7FqK+2e/dyNdQ==',key_name='tempest-keypair-236378161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad6e635ed030414f82235c8eb20083f2',ramdisk_id='',reservation_id='r-cfbmk76k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1402567886',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1402567886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:52:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fe26a3f4ffd4a019d4ffb1709479d79',uuid=6993f0e2-206d-49af-a77a-a9f39dcf5e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Converting VIF {"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG os_vif [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fccc8842-44e7-5264-84b1-fec87ffa8d27', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfea745cd-a2, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfea745cd-a2, col_values=(('qos', UUID('4e10a979-6cb4-49c2-862f-ee713431cf59')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfea745cd-a2, col_values=(('external_ids', {'iface-id': 'fea745cd-a2de-498c-9fd7-532d217e4939', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:73:18', 'vm-uuid': '6993f0e2-206d-49af-a77a-a9f39dcf5e38'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:13 user nova-compute[75438]: INFO os_vif [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2')
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No VIF found with MAC fa:16:3e:c5:73:18, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updated VIF entry in instance network info cache for port fea745cd-a2de-498c-9fd7-532d217e4939. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG nova.network.neutron [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:52:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-5523095f-a6a8-4e9c-8fac-80ca48092635 req-73bf79fd-cfb9-4646-9b57-da8a7664879d service nova] Releasing lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:52:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b6a9186-ddc1-4f2a-bd29-7da5f0e185b8 req-96444b40-dc2f-4911-a913-bc3a22facfa2 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b6a9186-ddc1-4f2a-bd29-7da5f0e185b8 req-96444b40-dc2f-4911-a913-bc3a22facfa2 service nova] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b6a9186-ddc1-4f2a-bd29-7da5f0e185b8 req-96444b40-dc2f-4911-a913-bc3a22facfa2 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4b6a9186-ddc1-4f2a-bd29-7da5f0e185b8 req-96444b40-dc2f-4911-a913-bc3a22facfa2 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG nova.compute.manager [req-4b6a9186-ddc1-4f2a-bd29-7da5f0e185b8 req-96444b40-dc2f-4911-a913-bc3a22facfa2 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] No waiting events found dispatching network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:52:15 user nova-compute[75438]: WARNING nova.compute.manager [req-4b6a9186-ddc1-4f2a-bd29-7da5f0e185b8 req-96444b40-dc2f-4911-a913-bc3a22facfa2 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received unexpected event network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 for instance with vm_state building and task_state spawning.
Nov 09 02:52:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:52:17 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Instance spawned successfully.
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:52:17 user nova-compute[75438]: INFO nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:52:17 user nova-compute[75438]: INFO nova.compute.manager [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Took 6.11 seconds to build instance.
Nov 09 02:52:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-264246d1-cf6a-4077-8818-f5672cbb14b4 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.231s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-7f9f87d5-6dcb-4325-9bc6-88aaf8698af6 req-ebbe237b-eddc-49a6-bcc9-f0c68a589a70 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7f9f87d5-6dcb-4325-9bc6-88aaf8698af6 req-ebbe237b-eddc-49a6-bcc9-f0c68a589a70 service nova] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7f9f87d5-6dcb-4325-9bc6-88aaf8698af6 req-ebbe237b-eddc-49a6-bcc9-f0c68a589a70 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-7f9f87d5-6dcb-4325-9bc6-88aaf8698af6 req-ebbe237b-eddc-49a6-bcc9-f0c68a589a70 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:52:17 user nova-compute[75438]: DEBUG nova.compute.manager [req-7f9f87d5-6dcb-4325-9bc6-88aaf8698af6 req-ebbe237b-eddc-49a6-bcc9-f0c68a589a70 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] No waiting events found dispatching network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:52:17 user nova-compute[75438]: WARNING nova.compute.manager [req-7f9f87d5-6dcb-4325-9bc6-88aaf8698af6 req-ebbe237b-eddc-49a6-bcc9-f0c68a589a70 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received unexpected event network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 for instance with vm_state active and task_state None.
Nov 09 02:52:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:21 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:52:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:52:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:52:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:52:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:52:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:52:58 user nova-compute[75438]: INFO nova.compute.manager [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Detaching volume 46b1bf67-c215-4474-bb59-0bcff38916fc
Nov 09 02:52:58 user nova-compute[75438]: INFO nova.virt.block_device [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Attempting to driver detach volume 46b1bf67-c215-4474-bb59-0bcff38916fc from mountpoint /dev/vdb
Nov 09 02:52:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Attempting to detach device vdb from instance 911643f6-ef54-4b59-8a02-0b103927e508 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:52:58 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:52:58 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:52:58 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:52:58 user nova-compute[75438]:   <serial>46b1bf67-c215-4474-bb59-0bcff38916fc</serial>
Nov 09 02:52:58 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:52:58 user nova-compute[75438]: </disk>
Nov 09 02:52:58 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:52:58 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully detached device vdb from instance 911643f6-ef54-4b59-8a02-0b103927e508 from the persistent domain config.
Nov 09 02:52:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 911643f6-ef54-4b59-8a02-0b103927e508 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:52:58 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:52:58 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:52:58 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:52:58 user nova-compute[75438]:   <serial>46b1bf67-c215-4474-bb59-0bcff38916fc</serial>
Nov 09 02:52:58 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:52:58 user nova-compute[75438]: </disk>
Nov 09 02:52:58 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:52:58 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Skipping network cache update for instance because it is being deleted. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:53:03 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:53:04 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:53:04 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:53:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:53:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:53:08 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:09 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:10 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:53:10 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=24.764060974121094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 911643f6-ef54-4b59-8a02-0b103927e508 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:53:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:11 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:11 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:53:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:53:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:53:18 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 911643f6-ef54-4b59-8a02-0b103927e508 is timed out.
Nov 09 02:53:18 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully detached device vdb from instance 911643f6-ef54-4b59-8a02-0b103927e508 from the live domain config.
Nov 09 02:53:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGQZDIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:53:18 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d856ca4-2b6e-4407-94df-952a11916bc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:53:18 user nova-compute[75438]: No targets found.
Nov 09 02:53:18 user nova-compute[75438]: iSNS:
Nov 09 02:53:18 user nova-compute[75438]: No targets found.
Nov 09 02:53:18 user nova-compute[75438]: STATIC:
Nov 09 02:53:18 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc
Nov 09 02:53:18 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:53:18 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:53:18 user nova-compute[75438]: FIRMWARE:
Nov 09 02:53:18 user nova-compute[75438]: No targets found.
Nov 09 02:53:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:53:18 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:53:18 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7afdc7-f291-41d1-9040-c734911873bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d872d8f-3592-4ad3-96fd-abc38d198134]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc (non-flash)
Nov 09 02:53:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc (non-flash)
Nov 09 02:53:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba24134ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1491dc8b-645e-449b-8602-c756867ab260]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d6f523-0e62-4138-bbf5-bd7beead7f6e]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32b2d7a-1743-490a-9117-9a94ae2da6eb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d9406f-fa0b-40e0-83a7-06885ee7b037]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18ba6e8-45f8-4b9b-9d00-8cf5a3c21bb0]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a2e84c-a499-4ff3-8681-2984c3a7c1e7]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260]
Nov 09 02:53:18 user nova-compute[75438]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc, portal: 172.16.0.220,3260] successful.
Nov 09 02:53:18 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ebca6a-7a73-4fb5-bb0d-dcc1fa26e9b5]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== disconnect_volume: return (286ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:53:18 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG nova.objects.instance [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'flavor' on Instance uuid 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-bc05c72e-9c7b-4bbd-9d1c-75f2c0aa5a98 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.799s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.679s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:19 user nova-compute[75438]: INFO nova.compute.manager [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Terminating instance
Nov 09 02:53:19 user nova-compute[75438]: DEBUG nova.compute.manager [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3b9a0ac-a686-4404-aaff-c39905b5fb49 req-e0faa58b-dd37-4482-b3a2-75eb8296d11a service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-vif-unplugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3b9a0ac-a686-4404-aaff-c39905b5fb49 req-e0faa58b-dd37-4482-b3a2-75eb8296d11a service nova] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3b9a0ac-a686-4404-aaff-c39905b5fb49 req-e0faa58b-dd37-4482-b3a2-75eb8296d11a service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-b3b9a0ac-a686-4404-aaff-c39905b5fb49 req-e0faa58b-dd37-4482-b3a2-75eb8296d11a service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3b9a0ac-a686-4404-aaff-c39905b5fb49 req-e0faa58b-dd37-4482-b3a2-75eb8296d11a service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] No waiting events found dispatching network-vif-unplugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.compute.manager [req-b3b9a0ac-a686-4404-aaff-c39905b5fb49 req-e0faa58b-dd37-4482-b3a2-75eb8296d11a service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-vif-unplugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Instance destroyed successfully.
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.objects.instance [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'resources' on Instance uuid 911643f6-ef54-4b59-8a02-0b103927e508 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:49:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-795228243',display_name='tempest-VolumesSnapshotTestJSON-instance-795228243',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-795228243',id=50,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqyIktCeFTfI5JDShTj3AHVG+N/MaMYImf7mzadYOr+JVUtOCx8vZl7eHYqDhtAmtygkRCnlb7Rl/3bMYFpJuWvIFX9DsJdlfOQ5DIXlC5zfP/bEGubkixxVCs5ob6Q4w==',key_name='tempest-keypair-1927421240',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86351f5b5ac64ab493c2a8db595fa7fa',ramdisk_id='',reservation_id='r-1226r14a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1997846373',owner_user_name='tempest-VolumesSnapshotTestJSON-1997846373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:49:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b0bc5ef7234e0c90b7e3d044f0aee2',uuid=911643f6-ef54-4b59-8a02-0b103927e508,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converting VIF {"id": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "address": "fa:16:3e:c7:78:5e", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbab3e8e0-db", "ovs_interfaceid": "bab3e8e0-dbd3-45a0-a678-e622d033ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_vif [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbab3e8e0-db, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f1c1a79-3559-4da2-aa6c-64c278c13827) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:20 user nova-compute[75438]: INFO os_vif [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=bab3e8e0-dbd3-45a0-a678-e622d033ede8,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbab3e8e0-db')
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:46b1bf67-c215-4474-bb59-0bcff38916fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGQZDIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:53:20 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[6a1c554f-48ff-4f4b-b53a-a703bde6f7e8]: Unexpected error while running command.
Nov 09 02:53:20 user nova-compute[75438]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:53:20 user nova-compute[75438]: Exit code: 21
Nov 09 02:53:20 user nova-compute[75438]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:53:20 user nova-compute[75438]: Stderr: '' {{(pid=87049) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 09 02:53:20 user nova-compute[75438]: Traceback (most recent call last):
Nov 09 02:53:20 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 09 02:53:20 user nova-compute[75438]:     ret = func(*f_args, **f_kwargs)
Nov 09 02:53:20 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 09 02:53:20 user nova-compute[75438]:     return func(*args, **kwargs)
Nov 09 02:53:20 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 09 02:53:20 user nova-compute[75438]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 09 02:53:20 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 09 02:53:20 user nova-compute[75438]:     return putils.execute(on_execute=on_execute,
Nov 09 02:53:20 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 09 02:53:20 user nova-compute[75438]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 09 02:53:20 user nova-compute[75438]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 02:53:20 user nova-compute[75438]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:53:20 user nova-compute[75438]: Exit code: 21
Nov 09 02:53:20 user nova-compute[75438]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:53:20 user nova-compute[75438]: Stderr: ''
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1c554f-48ff-4f4b-b53a-a703bde6f7e8]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 02:53:20 user nova-compute[75438]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:53:20 user nova-compute[75438]: Exit code: 21
Nov 09 02:53:20 user nova-compute[75438]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:53:20 user nova-compute[75438]: Stderr: ''
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 09 02:53:20 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75438) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== disconnect_volume: return (31ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:53:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Deleting instance files /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508_del
Nov 09 02:53:20 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Deletion of /opt/stack/data/nova/instances/911643f6-ef54-4b59-8a02-0b103927e508_del complete
Nov 09 02:53:20 user nova-compute[75438]: INFO nova.compute.manager [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 02:53:20 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:53:20 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:53:21 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:53:21 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Took 0.88 seconds to deallocate network for instance.
Nov 09 02:53:21 user nova-compute[75438]: DEBUG nova.compute.manager [req-d510aad3-ce84-404c-86e3-03518773aa08 req-9d508806-5eef-433a-923c-f20ba8fb86ac service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-vif-deleted-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:53:21 user nova-compute[75438]: WARNING nova.volume.cinder [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Attachment 918cf43a-9612-47dc-bbba-98d6aca32d78 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 918cf43a-9612-47dc-bbba-98d6aca32d78. (HTTP 404) (Request-ID: req-8f5ccb62-0b33-4e69-91e9-1d03c5d8151c)
Nov 09 02:53:21 user nova-compute[75438]: INFO nova.compute.manager [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Took 0.03 seconds to detach 1 volumes for instance.
Nov 09 02:53:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:53:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:21 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:53:21 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:53:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:21 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Deleted allocations for instance 911643f6-ef54-4b59-8a02-0b103927e508
Nov 09 02:53:21 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-59be96f9-c882-4211-b948-a7339806d02f tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "911643f6-ef54-4b59-8a02-0b103927e508" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-eace8029-3e06-4c42-8f98-278b74ca3466 req-aff6263b-e714-4c5f-9248-074b4ba8c5b0 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received event network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:53:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eace8029-3e06-4c42-8f98-278b74ca3466 req-aff6263b-e714-4c5f-9248-074b4ba8c5b0 service nova] Acquiring lock "911643f6-ef54-4b59-8a02-0b103927e508-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:53:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eace8029-3e06-4c42-8f98-278b74ca3466 req-aff6263b-e714-4c5f-9248-074b4ba8c5b0 service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:53:22 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-eace8029-3e06-4c42-8f98-278b74ca3466 req-aff6263b-e714-4c5f-9248-074b4ba8c5b0 service nova] Lock "911643f6-ef54-4b59-8a02-0b103927e508-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:53:22 user nova-compute[75438]: DEBUG nova.compute.manager [req-eace8029-3e06-4c42-8f98-278b74ca3466 req-aff6263b-e714-4c5f-9248-074b4ba8c5b0 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] No waiting events found dispatching network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:53:22 user nova-compute[75438]: WARNING nova.compute.manager [req-eace8029-3e06-4c42-8f98-278b74ca3466 req-aff6263b-e714-4c5f-9248-074b4ba8c5b0 service nova] [instance: 911643f6-ef54-4b59-8a02-0b103927e508] Received unexpected event network-vif-plugged-bab3e8e0-dbd3-45a0-a678-e622d033ede8 for instance with vm_state deleted and task_state None.
Nov 09 02:53:24 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:53:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:53:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:53:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:53:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:53:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:53:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-changed-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG nova.compute.manager [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Refreshing instance network info cache due to event network-changed-fea745cd-a2de-498c-9fd7-532d217e4939. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] Acquiring lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] Acquired lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Refreshing network info cache for port fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updated VIF entry in instance network info cache for port fea745cd-a2de-498c-9fd7-532d217e4939. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG nova.network.neutron [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-75e33376-e4f0-432f-b62b-49a5342fcf0d req-50b2b736-f0f2-4921-941c-19e63b169fac service nova] Releasing lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG nova.objects.instance [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'flavor' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:02 user nova-compute[75438]: INFO nova.compute.manager [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attaching volume 5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a to /dev/vdb
Nov 09 02:54:02 user nova-compute[75438]: DEBUG os_brick.utils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[642ec97a-509a-4f0a-96a4-31954798d149]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa707ef-ff8f-40c6-833b-8046494144e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc49fb3c-617d-462e-bec6-94f8efcda8f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44fc0bd-87de-46a5-a26f-29e44df53b4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:02 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:54:03 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:54:03 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[917646a9-a22f-45f1-a871-1f131455a163]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG os_brick.utils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:54:03 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating existing volume attachment record: cbb534c7-8939-4534-9313-1949c1159daa {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:54:04 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:54:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:54:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:54:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:11 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:54:11 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8969MB free_disk=24.79053497314453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:54:11 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:54:12 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:54:12 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:54:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:54:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:16 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:54:17 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:54:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjRWDQfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:54:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:54:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:54:25 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f796548-73d4-481d-9a45-5d34566bf09e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:54:25 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa07e1d-bb88-4c27-b9e8-6cd9c0882380]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a] added
Nov 09 02:54:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee80c5ff-cecc-41d1-a44d-d2ab6ff931a9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee6ef67-9f31-464e-93e3-f35ca4111122]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjRWDQfc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZjRWDQfc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[98210a4a-78a1-4535-8fdc-73eaea3484f7]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZjRWDQfc'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[476a97dc-9331-4a39-aa92-a5b322a10f03]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae223f-7ee4-47f5-80d9-6e2a87a505b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:54:25 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:54:25 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:54:25 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:54:25 user nova-compute[75438]: 
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ace31a-2abd-45b7-ad24-69ec58e3190c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260]
Nov 09 02:54:25 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260] successful.
Nov 09 02:54:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[216251ed-9dc8-45a3-a73b-9377a541c6a1]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6981ab-1d59-49ed-95a6-d3af91b9837f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:54:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:54:25 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:54:25 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:54:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:26 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:26 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47c18cc-0535-4701-ad44-cffccce0c05f]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:26 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:54:26 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjRWDQfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23565366334633130', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565366334633130', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG nova.objects.instance [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'flavor' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:54:27 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:54:27 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:54:27 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:54:27 user nova-compute[75438]:   <serial>5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a</serial>
Nov 09 02:54:27 user nova-compute[75438]: </disk>
Nov 09 02:54:27 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No VIF found with MAC fa:16:3e:c5:73:18, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:54:27 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-43029f39-fb15-4e01-915a-5b10310d90dd tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.756s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:54:29 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:54:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:30 user nova-compute[75438]: DEBUG nova.objects.instance [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'flavor' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:54:30 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:31 user nova-compute[75438]: INFO nova.compute.manager [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attaching volume 95a522cc-4871-4e62-9d27-c1b5c8425187 to /dev/vdc
Nov 09 02:54:31 user nova-compute[75438]: DEBUG os_brick.utils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7384b2-8a05-4c0a-afad-8e4a9e631a27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd198067-4e27-4725-bb0d-d80078ad41ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[57135f2d-2df5-4aa6-95f6-e9d33036b45b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab18eaa-1e94-4600-b7e3-7c2c39bc463f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:54:31 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:54:31 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1abcdf-bd2d-4ff3-b506-bc87aa71f433]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG os_brick.utils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:54:31 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating existing volume attachment record: 532e69fe-ebcc-49f3-80bb-d0a2c0776668 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:54:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:54:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Starting instance... {{(pid=75438) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75438) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 09 02:54:38 user nova-compute[75438]: INFO nova.compute.claims [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Claim successful on node user
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Start building networks asynchronously for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Allocating IP information in the background. {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.network.neutron [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] allocate_for_instance() {{(pid=75438) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 09 02:54:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Start building block device mappings for instance. {{(pid=75438) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.policy [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16b0bc5ef7234e0c90b7e3d044f0aee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86351f5b5ac64ab493c2a8db595fa7fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75438) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Start spawning the instance on the hypervisor. {{(pid=75438) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Creating instance directory {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 09 02:54:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Creating image(s)
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "/opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "/opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "/opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:38 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.180s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.184s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk 1073741824 {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399,backing_fmt=raw /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk 1073741824" returned: 0 in 0.052s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "fe9f0274a9d6633124cec4f2c4354d54adef4399" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Successfully created port: 60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fe9f0274a9d6633124cec4f2c4354d54adef4399 --force-share --output=json" returned: 0 in 0.176s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Checking if we can resize image /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk. size=1073741824 {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.virt.disk.api [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Cannot resize image /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk to a smaller size. {{(pid=75438) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Created local disks {{(pid=75438) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Ensure instance console log exists: /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/console.log {{(pid=75438) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Successfully updated port: 60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquired lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:54:39 user nova-compute[75438]: DEBUG nova.network.neutron [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Building network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-changed-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.compute.manager [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Refreshing instance network info cache due to event network-changed-60c98d21-9fb8-4ab6-a559-45ae0c214554. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] Acquiring lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.neutron [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Instance cache missing network info. {{(pid=75438) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.neutron [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating instance_info_cache with network_info: [{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Releasing lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Instance network_info: |[{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75438) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] Acquired lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.neutron [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Refreshing network info cache for port 60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Start _get_guest_xml network_info=[{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'encryption_secret_uuid': None, 'size': 0, 'device_type': 'disk', 'device_name': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'image_id': 'f16943d9-f085-4472-9bf0-c9432a882a19'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 09 02:54:40 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:54:40 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CPU controller missing on host. {{(pid=75438) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.host [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CPU controller found on host. {{(pid=75438) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75438) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-09T01:58:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-09T01:58:42Z,direct_url=<?>,disk_format='qcow2',id=f16943d9-f085-4472-9bf0-c9432a882a19,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f2cc72d56a114951a5ee9b9cf29ed959',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-09T01:58:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Flavor limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Image limits 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Flavor pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Image pref 0:0:0 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75438) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Got 1 possible topologies {{(pid=75438) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.hardware [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75438) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427585907',display_name='tempest-VolumesSnapshotTestJSON-instance-427585907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427585907',id=52,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMLxeC24zkRlZS0jtHikIJZFqY0P2LQiik4vccwcqRI+i/UGAlBX5zGBbnDuxvIgrhPxe3J+yjqr89fFbiYoJonBWoZfY+pbckggpw8F/ybZxgcMSs/dLYuuT38SdSgdQ==',key_name='tempest-keypair-923384425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86351f5b5ac64ab493c2a8db595fa7fa',ramdisk_id='',reservation_id='r-3kjpdhr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1997846373',owner_user_name='tempest-VolumesSnapshotTestJSON-1997846373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b0bc5ef7234e0c90b7e3d044f0aee2',uuid=978bc551-fbb6-4a45-b2b9-36ae31a8b5ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75438) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converting VIF {"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.objects.instance [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'pci_devices' on Instance uuid 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] End _get_guest_xml xml=<domain type="kvm">
Nov 09 02:54:40 user nova-compute[75438]:   <uuid>978bc551-fbb6-4a45-b2b9-36ae31a8b5ef</uuid>
Nov 09 02:54:40 user nova-compute[75438]:   <name>instance-00000034</name>
Nov 09 02:54:40 user nova-compute[75438]:   <memory>524288</memory>
Nov 09 02:54:40 user nova-compute[75438]:   <vcpu>1</vcpu>
Nov 09 02:54:40 user nova-compute[75438]:   <metadata>
Nov 09 02:54:40 user nova-compute[75438]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 09 02:54:40 user nova-compute[75438]:       <nova:package version="0.0.0"/>
Nov 09 02:54:40 user nova-compute[75438]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-427585907</nova:name>
Nov 09 02:54:40 user nova-compute[75438]:       <nova:creationTime>2023-11-09 02:54:40</nova:creationTime>
Nov 09 02:54:40 user nova-compute[75438]:       <nova:flavor name="m1.tiny">
Nov 09 02:54:40 user nova-compute[75438]:         <nova:memory>512</nova:memory>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:disk>1</nova:disk>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:swap>0</nova:swap>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:ephemeral>0</nova:ephemeral>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:vcpus>1</nova:vcpus>
Nov 09 02:54:40 user nova-compute[75438]:       </nova:flavor>
Nov 09 02:54:40 user nova-compute[75438]:       <nova:owner>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:user uuid="16b0bc5ef7234e0c90b7e3d044f0aee2">tempest-VolumesSnapshotTestJSON-1997846373-project-member</nova:user>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:project uuid="86351f5b5ac64ab493c2a8db595fa7fa">tempest-VolumesSnapshotTestJSON-1997846373</nova:project>
Nov 09 02:54:40 user nova-compute[75438]:       </nova:owner>
Nov 09 02:54:40 user nova-compute[75438]:       <nova:root type="image" uuid="f16943d9-f085-4472-9bf0-c9432a882a19"/>
Nov 09 02:54:40 user nova-compute[75438]:       <nova:ports>
Nov 09 02:54:40 user nova-compute[75438]:         <nova:port uuid="60c98d21-9fb8-4ab6-a559-45ae0c214554">
Nov 09 02:54:40 user nova-compute[75438]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 09 02:54:40 user nova-compute[75438]:         </nova:port>
Nov 09 02:54:40 user nova-compute[75438]:       </nova:ports>
Nov 09 02:54:40 user nova-compute[75438]:     </nova:instance>
Nov 09 02:54:40 user nova-compute[75438]:   </metadata>
Nov 09 02:54:40 user nova-compute[75438]:   <sysinfo type="smbios">
Nov 09 02:54:40 user nova-compute[75438]:     <system>
Nov 09 02:54:40 user nova-compute[75438]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 09 02:54:40 user nova-compute[75438]:       <entry name="product">OpenStack Nova</entry>
Nov 09 02:54:40 user nova-compute[75438]:       <entry name="version">0.0.0</entry>
Nov 09 02:54:40 user nova-compute[75438]:       <entry name="serial">978bc551-fbb6-4a45-b2b9-36ae31a8b5ef</entry>
Nov 09 02:54:40 user nova-compute[75438]:       <entry name="uuid">978bc551-fbb6-4a45-b2b9-36ae31a8b5ef</entry>
Nov 09 02:54:40 user nova-compute[75438]:       <entry name="family">Virtual Machine</entry>
Nov 09 02:54:40 user nova-compute[75438]:     </system>
Nov 09 02:54:40 user nova-compute[75438]:   </sysinfo>
Nov 09 02:54:40 user nova-compute[75438]:   <os>
Nov 09 02:54:40 user nova-compute[75438]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 09 02:54:40 user nova-compute[75438]:     <boot dev="hd"/>
Nov 09 02:54:40 user nova-compute[75438]:     <smbios mode="sysinfo"/>
Nov 09 02:54:40 user nova-compute[75438]:   </os>
Nov 09 02:54:40 user nova-compute[75438]:   <features>
Nov 09 02:54:40 user nova-compute[75438]:     <acpi/>
Nov 09 02:54:40 user nova-compute[75438]:     <apic/>
Nov 09 02:54:40 user nova-compute[75438]:     <vmcoreinfo/>
Nov 09 02:54:40 user nova-compute[75438]:   </features>
Nov 09 02:54:40 user nova-compute[75438]:   <clock offset="utc">
Nov 09 02:54:40 user nova-compute[75438]:     <timer name="pit" tickpolicy="delay"/>
Nov 09 02:54:40 user nova-compute[75438]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 09 02:54:40 user nova-compute[75438]:     <timer name="hpet" present="no"/>
Nov 09 02:54:40 user nova-compute[75438]:   </clock>
Nov 09 02:54:40 user nova-compute[75438]:   <cpu mode="custom" match="exact">
Nov 09 02:54:40 user nova-compute[75438]:     <model>Nehalem</model>
Nov 09 02:54:40 user nova-compute[75438]:     <topology sockets="1" cores="1" threads="1"/>
Nov 09 02:54:40 user nova-compute[75438]:   </cpu>
Nov 09 02:54:40 user nova-compute[75438]:   <devices>
Nov 09 02:54:40 user nova-compute[75438]:     <disk type="file" device="disk">
Nov 09 02:54:40 user nova-compute[75438]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 09 02:54:40 user nova-compute[75438]:       <source file="/opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk"/>
Nov 09 02:54:40 user nova-compute[75438]:       <target dev="vda" bus="virtio"/>
Nov 09 02:54:40 user nova-compute[75438]:     </disk>
Nov 09 02:54:40 user nova-compute[75438]:     <interface type="ethernet">
Nov 09 02:54:40 user nova-compute[75438]:       <mac address="fa:16:3e:0a:48:f3"/>
Nov 09 02:54:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:54:40 user nova-compute[75438]:       <mtu size="1442"/>
Nov 09 02:54:40 user nova-compute[75438]:       <target dev="tap60c98d21-9f"/>
Nov 09 02:54:40 user nova-compute[75438]:     </interface>
Nov 09 02:54:40 user nova-compute[75438]:     <serial type="pty">
Nov 09 02:54:40 user nova-compute[75438]:       <log file="/opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/console.log" append="off"/>
Nov 09 02:54:40 user nova-compute[75438]:     </serial>
Nov 09 02:54:40 user nova-compute[75438]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 09 02:54:40 user nova-compute[75438]:     <video>
Nov 09 02:54:40 user nova-compute[75438]:       <model type="virtio"/>
Nov 09 02:54:40 user nova-compute[75438]:     </video>
Nov 09 02:54:40 user nova-compute[75438]:     <rng model="virtio">
Nov 09 02:54:40 user nova-compute[75438]:       <backend model="random">/dev/urandom</backend>
Nov 09 02:54:40 user nova-compute[75438]:     </rng>
Nov 09 02:54:40 user nova-compute[75438]:     <controller type="usb" index="0" model="none"/>
Nov 09 02:54:40 user nova-compute[75438]:     <memballoon model="virtio">
Nov 09 02:54:40 user nova-compute[75438]:       <stats period="10"/>
Nov 09 02:54:40 user nova-compute[75438]:     </memballoon>
Nov 09 02:54:40 user nova-compute[75438]:   </devices>
Nov 09 02:54:40 user nova-compute[75438]: </domain>
Nov 09 02:54:40 user nova-compute[75438]:  {{(pid=75438) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427585907',display_name='tempest-VolumesSnapshotTestJSON-instance-427585907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427585907',id=52,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMLxeC24zkRlZS0jtHikIJZFqY0P2LQiik4vccwcqRI+i/UGAlBX5zGBbnDuxvIgrhPxe3J+yjqr89fFbiYoJonBWoZfY+pbckggpw8F/ybZxgcMSs/dLYuuT38SdSgdQ==',key_name='tempest-keypair-923384425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86351f5b5ac64ab493c2a8db595fa7fa',ramdisk_id='',reservation_id='r-3kjpdhr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1997846373',owner_user_name='tempest-VolumesSnapshotTestJSON-1997846373-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-09T02:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b0bc5ef7234e0c90b7e3d044f0aee2',uuid=978bc551-fbb6-4a45-b2b9-36ae31a8b5ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converting VIF {"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG os_vif [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f') {{(pid=75438) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e25c342-e889-5883-a808-bfc5f8168259', '_type': 'linux-noop'}}, row=False) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60c98d21-9f, may_exist=True, interface_attrs={}) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60c98d21-9f, col_values=(('qos', UUID('89881ab8-a694-44d3-82d2-71689a118054')),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60c98d21-9f, col_values=(('external_ids', {'iface-id': '60c98d21-9fb8-4ab6-a559-45ae0c214554', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:48:f3', 'vm-uuid': '978bc551-fbb6-4a45-b2b9-36ae31a8b5ef'}),), if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:40 user nova-compute[75438]: INFO os_vif [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f')
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No VIF found with MAC fa:16:3e:0a:48:f3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.neutron [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updated VIF entry in instance network info cache for port 60c98d21-9fb8-4ab6-a559-45ae0c214554. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG nova.network.neutron [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating instance_info_cache with network_info: [{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:54:40 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-4a25100f-4c09-4ff9-a3ef-84c3e3594f0c req-fa0b9bab-a192-4770-b85e-9c2647839ab9 service nova] Releasing lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:54:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:41 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] No waiting events found dispatching network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:54:42 user nova-compute[75438]: WARNING nova.compute.manager [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received unexpected event network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 for instance with vm_state building and task_state spawning.
Nov 09 02:54:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG nova.compute.manager [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] No waiting events found dispatching network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:54:42 user nova-compute[75438]: WARNING nova.compute.manager [req-d7a80d64-d1cf-48fa-8c07-72ee1d5fa411 req-c86ab4ec-f97b-4f53-b30a-879cd2c12134 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received unexpected event network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 for instance with vm_state building and task_state spawning.
Nov 09 02:54:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:42 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Instance event wait completed in 0 seconds for  {{(pid=75438) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Guest created on hypervisor {{(pid=75438) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 09 02:54:43 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Instance spawned successfully.
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Found default for hw_cdrom_bus of ide {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Found default for hw_disk_bus of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Found default for hw_input_bus of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Found default for hw_pointer_model of None {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Found default for hw_video_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Found default for hw_vif_model of virtio {{(pid=75438) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 09 02:54:43 user nova-compute[75438]: INFO nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 09 02:54:43 user nova-compute[75438]: DEBUG nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Checking state {{(pid=75438) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 09 02:54:43 user nova-compute[75438]: INFO nova.compute.manager [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Took 5.59 seconds to build instance.
Nov 09 02:54:43 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22fa1b68-cef3-4ec3-a5db-a273664288e0 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.686s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwbghJDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:54:53 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:54:53 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:54:53 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8ecc02-e2b2-49e8-be98-1417209617e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:54:53 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80aee3b-7bcd-49da-9e3a-3bd31ef80617]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187] added
Nov 09 02:54:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b71ceae-c601-431a-87d3-4b6314a9c8b2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d87e4c-fc9d-44c6-9652-9276d1b68d63]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MwbghJDk {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MwbghJDk" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a4493-6649-42fd-b7ca-f98f786e8fc2]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MwbghJDk'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f782dbd0-03b0-4652-8769-89e2a364b52f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bab54c-47ab-4707-8a41-ad074aa6d00f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:54:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:54:53 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:54:53 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0d11a-885d-42e3-8b75-b74a662254c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260]
Nov 09 02:54:54 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260] successful.
Nov 09 02:54:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[98757f1d-396a-4dd7-9db0-64eefd6673a3]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[17efa19a-ae84-4ff5-8abe-7551895c1492]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:54:54 user nova-compute[75438]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 (non-flash)
Nov 09 02:54:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:54:54 user nova-compute[75438]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 (non-flash)
Nov 09 02:54:54 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981a405-5617-44d2-9dc5-f8a5d03e2065]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:54:54 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwbghJDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23834396666333963', 'path': '/dev/sdc'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834396666333963', 'path': '/dev/sdc'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.objects.instance [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'flavor' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:54:55 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:54:55 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:54:55 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:54:55 user nova-compute[75438]:   <serial>95a522cc-4871-4e62-9d27-c1b5c8425187</serial>
Nov 09 02:54:55 user nova-compute[75438]: </disk>
Nov 09 02:54:55 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] No VIF found with MAC fa:16:3e:c5:73:18, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:54:55 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-04c919f2-e403-446c-b7de-6f8a60fa9790 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.520s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:54:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:54:56 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:54:56 user nova-compute[75438]: INFO nova.compute.manager [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Detaching volume 95a522cc-4871-4e62-9d27-c1b5c8425187
Nov 09 02:54:56 user nova-compute[75438]: INFO nova.virt.block_device [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attempting to driver detach volume 95a522cc-4871-4e62-9d27-c1b5c8425187 from mountpoint /dev/vdc
Nov 09 02:54:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Attempting to detach device vdc from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:54:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:54:56 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:54:56 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:54:56 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:54:56 user nova-compute[75438]:   <serial>95a522cc-4871-4e62-9d27-c1b5c8425187</serial>
Nov 09 02:54:56 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 02:54:56 user nova-compute[75438]: </disk>
Nov 09 02:54:56 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:54:56 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Successfully detached device vdc from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the persistent domain config.
Nov 09 02:54:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:54:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:54:56 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:54:56 user nova-compute[75438]:   <source dev="/dev/sdc"/>
Nov 09 02:54:56 user nova-compute[75438]:   <target dev="vdc" bus="virtio"/>
Nov 09 02:54:56 user nova-compute[75438]:   <serial>95a522cc-4871-4e62-9d27-c1b5c8425187</serial>
Nov 09 02:54:56 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 09 02:54:56 user nova-compute[75438]: </disk>
Nov 09 02:54:56 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:54:56 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:55:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:55:06 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:55:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [{"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:55:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-6993f0e2-206d-49af-a77a-a9f39dcf5e38" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:55:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:55:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:55:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:11 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:55:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:55:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8859MB free_disk=24.759963989257812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:55:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:55:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:16 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 is timed out.
Nov 09 02:55:16 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Successfully detached device vdc from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the live domain config.
Nov 09 02:55:16 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwbghJDk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:55:16 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:55:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[26613dc0-8964-48b5-ad91-f24e8f876d5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:55:16 user nova-compute[75438]: No targets found.
Nov 09 02:55:16 user nova-compute[75438]: iSNS:
Nov 09 02:55:16 user nova-compute[75438]: No targets found.
Nov 09 02:55:16 user nova-compute[75438]: STATIC:
Nov 09 02:55:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187
Nov 09 02:55:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:55:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:55:16 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a
Nov 09 02:55:16 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:55:16 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:55:16 user nova-compute[75438]: FIRMWARE:
Nov 09 02:55:16 user nova-compute[75438]: No targets found.
Nov 09 02:55:16 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:55:16 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:55:16 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:16 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[15caffc3-d556-4c5d-b61e-157f8ecbd87e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c2d3a3-d5d3-4f7e-921f-de276c38ae4f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:55:17 user nova-compute[75438]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 (non-flash)
Nov 09 02:55:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:55:17 user nova-compute[75438]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 (non-flash)
Nov 09 02:55:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba04438c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187'): ({'sdc'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Removing single pathed devices sdc {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb151be-245f-4ce2-80c2-976e6e13a0cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[70977464-458f-4f2c-9071-e83dccb045cf]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Flushing IO for device /dev/sdc {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3c3b73-aac6-47f3-9b98-6e6300a583b9]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b488a024-c3f9-4609-ac10-8759f7113160]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] SCSI volumes sdc have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[97694768-5f17-4b90-a1fb-517f838ca35b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d2cb42-9384-4ef1-9f0f-7d700f10f522]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260]
Nov 09 02:55:17 user nova-compute[75438]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187, portal: 172.16.0.220,3260] successful.
Nov 09 02:55:17 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95a522cc-4871-4e62-9d27-c1b5c8425187 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f99e34e-b137-4a52-830c-bdc39f129f5b]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] <== disconnect_volume: return (297ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:55:17 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:55:18 user nova-compute[75438]: DEBUG nova.objects.instance [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'flavor' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:55:18 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-5f7f3d9c-846c-4d7d-ba45-8dcee1c011c5 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.859s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:55:19 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:55:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:55:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:55:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:24 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:55:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:55:46 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:55:46 user nova-compute[75438]: INFO nova.compute.manager [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Detaching volume 5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a
Nov 09 02:55:46 user nova-compute[75438]: INFO nova.virt.block_device [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Attempting to driver detach volume 5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a from mountpoint /dev/vdb
Nov 09 02:55:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Attempting to detach device vdb from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:55:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:55:47 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:55:47 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:55:47 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:55:47 user nova-compute[75438]:   <serial>5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a</serial>
Nov 09 02:55:47 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:55:47 user nova-compute[75438]: </disk>
Nov 09 02:55:47 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:55:47 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Successfully detached device vdb from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the persistent domain config.
Nov 09 02:55:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:55:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:55:47 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:55:47 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:55:47 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:55:47 user nova-compute[75438]:   <serial>5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a</serial>
Nov 09 02:55:47 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:55:47 user nova-compute[75438]: </disk>
Nov 09 02:55:47 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:55:47 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:55:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:55:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:55:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:55:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:55:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:55:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:00 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:00 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:56:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating instance_info_cache with network_info: [{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:56:07 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 is timed out.
Nov 09 02:56:07 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Successfully detached device vdb from instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 from the live domain config.
Nov 09 02:56:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZjRWDQfc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:56:07 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14c554b-dd11-4f05-80b2-4d46d5ff1e5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:56:07 user nova-compute[75438]: No targets found.
Nov 09 02:56:07 user nova-compute[75438]: iSNS:
Nov 09 02:56:07 user nova-compute[75438]: No targets found.
Nov 09 02:56:07 user nova-compute[75438]: STATIC:
Nov 09 02:56:07 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a
Nov 09 02:56:07 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:56:07 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:56:07 user nova-compute[75438]: FIRMWARE:
Nov 09 02:56:07 user nova-compute[75438]: No targets found.
Nov 09 02:56:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:56:07 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:56:07 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa476466-0ea7-4760-a3e7-e86add532dae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14b6934-3d8f-425e-8a5d-39c7457fa980]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:56:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a (non-flash)
Nov 09 02:56:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba04464b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214582b-bc3f-45c2-9983-ee9030c97e14]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8dcf30-e42a-4db0-b2b2-992d590670d0]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[995d0ad9-a416-487a-a5c4-20bf23bb00e6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a69394-41c3-49db-8e63-bc121bd192ab]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4849344e-a83e-4cb2-b37a-15f8a4685792]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7d151-c299-4418-8e11-0e356fda426f]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260]
Nov 09 02:56:07 user nova-compute[75438]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a, portal: 172.16.0.220,3260] successful.
Nov 09 02:56:07 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e2c67a0-9d39-4f4e-9103-3d0ad1d2ea8a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7a17fa-9a3a-4697-afff-d1dd5aab2ddb]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] <== disconnect_volume: return (293ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:56:07 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:56:08 user nova-compute[75438]: DEBUG nova.objects.instance [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'flavor' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:56:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-239f4a28-7d6e-4548-bab0-27852514e531 tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.016s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:56:10 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:56:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=24.759056091308594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:56:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:19 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:56:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:56:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:56:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:56:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-changed-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG nova.compute.manager [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Refreshing instance network info cache due to event network-changed-60c98d21-9fb8-4ab6-a559-45ae0c214554. {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] Acquiring lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] Acquired lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Refreshing network info cache for port 60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'flavor' on Instance uuid 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:56:29 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Ignoring supplied device name: /dev/vdb
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:29 user nova-compute[75438]: INFO nova.compute.manager [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Attaching volume 48e4eed6-2108-4902-9849-c78ffe4ce04a to /dev/vdb
Nov 09 02:56:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updated VIF entry in instance network info cache for port 60c98d21-9fb8-4ab6-a559-45ae0c214554. {{(pid=75438) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG nova.network.neutron [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating instance_info_cache with network_info: [{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-599b5ebe-3e68-45cb-970f-279edc10d62e req-a0682416-d1be-4f94-9adb-3535aa6908a1 service nova] Releasing lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG os_brick.utils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f3e107-1bd1-4b45-b9bc-a8de988ee6f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:30d5bfd9d6b\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b255def6-6ee1-412c-86b1-9f0b3b0ceccd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9dfd7-b77c-4abb-83ef-848fac418a3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf9453-5133-4281-be31-b99f3fd5f49f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:29 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Running cmd (subprocess): nvme version {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] 'nvme version' failed. Not Retrying. {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] nvme not present on system {{(pid=75438) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:56:30 user nova-compute[75438]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 09 02:56:30 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ea3c74-c2d0-4a97-8a8e-0288f6cec611]: (4, '') {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75438) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] LIGHTOS: no hostnqn found. {{(pid=75438) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG os_brick.utils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:30d5bfd9d6b', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG nova.virt.block_device [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating existing volume attachment record: c9dd0d29-4e5e-422d-aff4-fd83774e7587 {{(pid=75438) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 09 02:56:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:31 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:36 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:37 user nova-compute[75438]: INFO nova.compute.manager [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Terminating instance
Nov 09 02:56:37 user nova-compute[75438]: DEBUG nova.compute.manager [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-33916e9e-1d34-4fd2-a7a7-6373794fc4c8 req-f38f1f5a-9f29-4e58-8486-05cb20faf1e5 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-vif-unplugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-33916e9e-1d34-4fd2-a7a7-6373794fc4c8 req-f38f1f5a-9f29-4e58-8486-05cb20faf1e5 service nova] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-33916e9e-1d34-4fd2-a7a7-6373794fc4c8 req-f38f1f5a-9f29-4e58-8486-05cb20faf1e5 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-33916e9e-1d34-4fd2-a7a7-6373794fc4c8 req-f38f1f5a-9f29-4e58-8486-05cb20faf1e5 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-33916e9e-1d34-4fd2-a7a7-6373794fc4c8 req-f38f1f5a-9f29-4e58-8486-05cb20faf1e5 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] No waiting events found dispatching network-vif-unplugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG nova.compute.manager [req-33916e9e-1d34-4fd2-a7a7-6373794fc4c8 req-f38f1f5a-9f29-4e58-8486-05cb20faf1e5 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-vif-unplugged-fea745cd-a2de-498c-9fd7-532d217e4939 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:56:37 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Instance destroyed successfully.
Nov 09 02:56:38 user nova-compute[75438]: DEBUG nova.objects.instance [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lazy-loading 'resources' on Instance uuid 6993f0e2-206d-49af-a77a-a9f39dcf5e38 {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1912706093',display_name='tempest-TestServerVolumeAttachmentScenario-server-1912706093',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1912706093',id=51,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP20v9EGy5rp7X9hkCP7J9+9jDTH2KaBNEgFPXr0ewRuU1xUIDtY0+Ej50Xxg0QM0MuZ1uCPeiUftShdi5i1HbUweTZuMwRn2WtUqLP6BHMJHYkYRp2rA7FqK+2e/dyNdQ==',key_name='tempest-keypair-236378161',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:52:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad6e635ed030414f82235c8eb20083f2',ramdisk_id='',reservation_id='r-cfbmk76k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1402567886',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1402567886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:52:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fe26a3f4ffd4a019d4ffb1709479d79',uuid=6993f0e2-206d-49af-a77a-a9f39dcf5e38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Converting VIF {"id": "fea745cd-a2de-498c-9fd7-532d217e4939", "address": "fa:16:3e:c5:73:18", "network": {"id": "b979538d-4428-4328-a9a6-8360dd78ea7b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2044306909-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad6e635ed030414f82235c8eb20083f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea745cd-a2", "ovs_interfaceid": "fea745cd-a2de-498c-9fd7-532d217e4939", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG os_vif [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfea745cd-a2, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e10a979-6cb4-49c2-862f-ee713431cf59) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:38 user nova-compute[75438]: INFO os_vif [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:73:18,bridge_name='br-int',has_traffic_filtering=True,id=fea745cd-a2de-498c-9fd7-532d217e4939,network=Network(b979538d-4428-4328-a9a6-8360dd78ea7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea745cd-a2')
Nov 09 02:56:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Deleting instance files /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38_del
Nov 09 02:56:38 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Deletion of /opt/stack/data/nova/instances/6993f0e2-206d-49af-a77a-a9f39dcf5e38_del complete
Nov 09 02:56:38 user nova-compute[75438]: INFO nova.compute.manager [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 09 02:56:38 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:56:38 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:56:39 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Took 0.89 seconds to deallocate network for instance.
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:39 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Deleted allocations for instance 6993f0e2-206d-49af-a77a-a9f39dcf5e38
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-fb337ab7-5d7b-48fc-b117-06d9efe9cf8e tempest-TestServerVolumeAttachmentScenario-1402567886 tempest-TestServerVolumeAttachmentScenario-1402567886-project-member] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.294s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] Acquiring lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] Lock "6993f0e2-206d-49af-a77a-a9f39dcf5e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] No waiting events found dispatching network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:56:39 user nova-compute[75438]: WARNING nova.compute.manager [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received unexpected event network-vif-plugged-fea745cd-a2de-498c-9fd7-532d217e4939 for instance with vm_state deleted and task_state None.
Nov 09 02:56:39 user nova-compute[75438]: DEBUG nova.compute.manager [req-343fdcf2-1020-4368-996d-50f7d2ec9807 req-8ce2a773-77ab-480e-99b8-d14f337adb27 service nova] [instance: 6993f0e2-206d-49af-a77a-a9f39dcf5e38] Received event network-vif-deleted-fea745cd-a2de-498c-9fd7-532d217e4939 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:56:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:46 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Calling os-brick to attach iSCSI Volume {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWUcMQif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:56:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:56:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:56:51 user nova-compute[75438]: INFO os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783b13f-9d97-4a55-a5e6-cf165008969b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 09 02:56:51 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --interface default --op new {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619aa01-3ab9-49e6-b4b7-ac49ff726a88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a] added\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a] added
Nov 09 02:56:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1f0074-0a2a-45c4-bcdf-de962657b57a]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[585a97aa-bb11-4812-8938-9e0411b02599]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWUcMQif {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWUcMQif" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69db646-1cef-4531-8d94-824a38b6354f]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sWUcMQif'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[420ae178-1591-433b-8ade-a4d488ee6d66]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae2f7d9-f638-42a7-bf00-1579da405f7e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:56:51 user nova-compute[75438]:  {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 09 02:56:51 user nova-compute[75438]:  {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:56:51 user nova-compute[75438]: WARNING os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 09 02:56:51 user nova-compute[75438]: 
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --login {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[02df937a-7d34-492e-a0b4-1d4376373ee3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260]
Nov 09 02:56:51 user nova-compute[75438]: Login to [iface: default, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260] successful.
Nov 09 02:56:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[560dcac2-e996-4980-aed3-d4e0c74a5721]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a955f6-eaaf-4ea3-8924-6c1b8426cdde]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a (non-flash)
Nov 09 02:56:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a (non-flash)
Nov 09 02:56:51 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Connected to 172.16.0.220:3260 {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75438) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75438) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[46479b29-b9a7-4666-9318-3cac49cef2fa]: (4, ('- - 0', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75438) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 09 02:56:51 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWUcMQif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75438) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 09 02:56:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:56:52 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23666333231636364', 'path': '/dev/sdb'} {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:56:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666333231636364', 'path': '/dev/sdb'} {{(pid=75438) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 09 02:56:52 user nova-compute[75438]: DEBUG nova.objects.instance [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'flavor' on Instance uuid 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:56:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] attach device xml: <disk type="block" device="disk">
Nov 09 02:56:52 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:56:52 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:56:52 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:56:52 user nova-compute[75438]:   <serial>48e4eed6-2108-4902-9849-c78ffe4ce04a</serial>
Nov 09 02:56:52 user nova-compute[75438]: </disk>
Nov 09 02:56:52 user nova-compute[75438]:  {{(pid=75438) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 09 02:56:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:56:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No BDM found with device name vda, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:56:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75438) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 09 02:56:53 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] No VIF found with MAC fa:16:3e:0a:48:f3, not building metadata {{(pid=75438) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 09 02:56:53 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-d2d8732e-46ce-4bfc-8788-d012a0be28a2 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.575s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:56:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:01 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:02 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:02 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:57:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquired lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Forcefully refreshing network info cache for instance {{(pid=75438) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 09 02:57:07 user nova-compute[75438]: DEBUG nova.objects.instance [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lazy-loading 'info_cache' on Instance uuid 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG nova.network.neutron [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating instance_info_cache with network_info: [{"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Releasing lock "refresh_cache-978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" {{(pid=75438) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 09 02:57:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updated the network info_cache for instance {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 09 02:57:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:57:11 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75438) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 09 02:57:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:57:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=24.785720825195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:57:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:57:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:13 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:18 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:57:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:23 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:28 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:29 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:57:33 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:57:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:38 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:57:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:57:52 user nova-compute[75438]: INFO nova.compute.manager [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Detaching volume 48e4eed6-2108-4902-9849-c78ffe4ce04a
Nov 09 02:57:52 user nova-compute[75438]: INFO nova.virt.block_device [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Attempting to driver detach volume 48e4eed6-2108-4902-9849-c78ffe4ce04a from mountpoint /dev/vdb
Nov 09 02:57:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Attempting to detach device vdb from instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef from the persistent domain config. {{(pid=75438) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 09 02:57:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:57:52 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:57:52 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:57:52 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:57:52 user nova-compute[75438]:   <serial>48e4eed6-2108-4902-9849-c78ffe4ce04a</serial>
Nov 09 02:57:52 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:57:52 user nova-compute[75438]: </disk>
Nov 09 02:57:52 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:57:52 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully detached device vdb from instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef from the persistent domain config.
Nov 09 02:57:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef from the live domain config. {{(pid=75438) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 09 02:57:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.guest [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] detach device xml: <disk type="block" device="disk">
Nov 09 02:57:52 user nova-compute[75438]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 09 02:57:52 user nova-compute[75438]:   <source dev="/dev/sdb"/>
Nov 09 02:57:52 user nova-compute[75438]:   <target dev="vdb" bus="virtio"/>
Nov 09 02:57:52 user nova-compute[75438]:   <serial>48e4eed6-2108-4902-9849-c78ffe4ce04a</serial>
Nov 09 02:57:52 user nova-compute[75438]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 09 02:57:52 user nova-compute[75438]: </disk>
Nov 09 02:57:52 user nova-compute[75438]:  {{(pid=75438) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 09 02:57:52 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:57:52 user nova-compute[75438]: DEBUG nova.virt.libvirt.driver [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:53 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:57 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:57:58 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:03 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:04 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:04 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Skipping network cache update for instance because it is being deleted. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 09 02:58:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:58:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:11 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:12 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef is timed out.
Nov 09 02:58:12 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully detached device vdb from instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef from the live domain config.
Nov 09 02:58:12 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:58:12 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWUcMQif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:58:13 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cad1419-6a1f-494e-88f6-16ea83ee110f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 09 02:58:13 user nova-compute[75438]: No targets found.
Nov 09 02:58:13 user nova-compute[75438]: iSNS:
Nov 09 02:58:13 user nova-compute[75438]: No targets found.
Nov 09 02:58:13 user nova-compute[75438]: STATIC:
Nov 09 02:58:13 user nova-compute[75438]: Target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a
Nov 09 02:58:13 user nova-compute[75438]:         Portal: 172.16.0.220:3260,-1
Nov 09 02:58:13 user nova-compute[75438]:                 Iface Name: default
Nov 09 02:58:13 user nova-compute[75438]: FIRMWARE:
Nov 09 02:58:13 user nova-compute[75438]: No targets found.
Nov 09 02:58:13 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 09 02:58:13 user nova-compute[75438]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 09 02:58:13 user nova-compute[75438]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75438) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a', 0)] {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[2affc455-7809-452c-a17e-51fb54f869dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b001365-5d4d-4f2d-9d09-82b9196c313b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a (non-flash)\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a (non-flash)
Nov 09 02:58:13 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a (non-flash)
Nov 09 02:58:13 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fba241a7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a'): ({'sdb'}, set())}) {{(pid=75438) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Removing single pathed devices sdb {{(pid=75438) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0318cff-d2d8-4ac6-bdaf-51f636d740ba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ed74a-6cc2-4d16-8192-de7529615738]: (4, ('ok\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Flushing IO for device /dev/sdb {{(pid=75438) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6df927-5a5c-42f6-9a3a-061fea276440]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75438) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceede98d-4f56-40e9-aa46-14e8c3bd41db]: (4, ('1', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.linuxscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] SCSI volumes sdb have been removed. {{(pid=75438) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a')] {{(pid=75438) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[4571273f-c81f-4411-9a10-73a3852f74d6]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --logout {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b2c335-b431-45cf-93f7-bcfdf4a77e8e]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260]
Nov 09 02:58:13 user nova-compute[75438]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a, portal: 172.16.0.220,3260] successful.
Nov 09 02:58:13 user nova-compute[75438]:  stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op delete {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc468da1-d33c-470a-9c58-1b9ffe6d1b31]: (4, ('', '')) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75438) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== disconnect_volume: return (307ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75438) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:58:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=24.76834487915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75438) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:58:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG nova.objects.instance [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'flavor' on Instance uuid 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-22ecb566-3ec2-45c1-8bd4-744ad4c47369 tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.959s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.819s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:14 user nova-compute[75438]: INFO nova.compute.manager [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Terminating instance
Nov 09 02:58:14 user nova-compute[75438]: DEBUG nova.compute.manager [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Start destroying the instance on the hypervisor. {{(pid=75438) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-461849e8-10d4-4999-9b3d-e2af158ca427 req-1ee6ee6c-2269-43fc-bd9f-498e820d7514 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-vif-unplugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-461849e8-10d4-4999-9b3d-e2af158ca427 req-1ee6ee6c-2269-43fc-bd9f-498e820d7514 service nova] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-461849e8-10d4-4999-9b3d-e2af158ca427 req-1ee6ee6c-2269-43fc-bd9f-498e820d7514 service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-461849e8-10d4-4999-9b3d-e2af158ca427 req-1ee6ee6c-2269-43fc-bd9f-498e820d7514 service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-461849e8-10d4-4999-9b3d-e2af158ca427 req-1ee6ee6c-2269-43fc-bd9f-498e820d7514 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] No waiting events found dispatching network-vif-unplugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG nova.compute.manager [req-461849e8-10d4-4999-9b3d-e2af158ca427 req-1ee6ee6c-2269-43fc-bd9f-498e820d7514 service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-vif-unplugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 for instance with task_state deleting. {{(pid=75438) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [-] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Instance destroyed successfully.
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.objects.instance [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lazy-loading 'resources' on Instance uuid 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef {{(pid=75438) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.vif [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-09T02:54:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-427585907',display_name='tempest-VolumesSnapshotTestJSON-instance-427585907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-427585907',id=52,image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMLxeC24zkRlZS0jtHikIJZFqY0P2LQiik4vccwcqRI+i/UGAlBX5zGBbnDuxvIgrhPxe3J+yjqr89fFbiYoJonBWoZfY+pbckggpw8F/ybZxgcMSs/dLYuuT38SdSgdQ==',key_name='tempest-keypair-923384425',keypairs=<?>,launch_index=0,launched_at=2023-11-09T02:54:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86351f5b5ac64ab493c2a8db595fa7fa',ramdisk_id='',reservation_id='r-3kjpdhr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f16943d9-f085-4472-9bf0-c9432a882a19',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1997846373',owner_user_name='tempest-VolumesSnapshotTestJSON-1997846373-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-09T02:54:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16b0bc5ef7234e0c90b7e3d044f0aee2',uuid=978bc551-fbb6-4a45-b2b9-36ae31a8b5ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converting VIF {"id": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "address": "fa:16:3e:0a:48:f3", "network": {"id": "b4b59d89-62de-4f2f-a976-c64045c22a9b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-181519465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86351f5b5ac64ab493c2a8db595fa7fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c98d21-9f", "ovs_interfaceid": "60c98d21-9fb8-4ab6-a559-45ae0c214554", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.network.os_vif_util [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f') {{(pid=75438) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_vif [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f') {{(pid=75438) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60c98d21-9f, bridge=br-int, if_exists=True) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=89881ab8-a694-44d3-82d2-71689a118054) {{(pid=75438) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:58:15 user nova-compute[75438]: INFO os_vif [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:48:f3,bridge_name='br-int',has_traffic_filtering=True,id=60c98d21-9fb8-4ab6-a559-45ae0c214554,network=Network(b4b59d89-62de-4f2f-a976-c64045c22a9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c98d21-9f')
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] calling os-brick to detach iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fba2455f7c0>, {'target_iqn': 'iqn.2010-10.org.openstack:48e4eed6-2108-4902-9849-c78ffe4ce04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWUcMQif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 09 02:58:15 user nova-compute[75438]: WARNING os_brick.initiator.connectors.base [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=87049) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[95317fbe-352b-4148-bb62-929ba0b97ea1]: Unexpected error while running command.
Nov 09 02:58:15 user nova-compute[75438]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:58:15 user nova-compute[75438]: Exit code: 21
Nov 09 02:58:15 user nova-compute[75438]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:58:15 user nova-compute[75438]: Stderr: '' {{(pid=87049) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 09 02:58:15 user nova-compute[75438]: Traceback (most recent call last):
Nov 09 02:58:15 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 09 02:58:15 user nova-compute[75438]:     ret = func(*f_args, **f_kwargs)
Nov 09 02:58:15 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 09 02:58:15 user nova-compute[75438]:     return func(*args, **kwargs)
Nov 09 02:58:15 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 09 02:58:15 user nova-compute[75438]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 09 02:58:15 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 09 02:58:15 user nova-compute[75438]:     return putils.execute(on_execute=on_execute,
Nov 09 02:58:15 user nova-compute[75438]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 09 02:58:15 user nova-compute[75438]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 09 02:58:15 user nova-compute[75438]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 02:58:15 user nova-compute[75438]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:58:15 user nova-compute[75438]: Exit code: 21
Nov 09 02:58:15 user nova-compute[75438]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:58:15 user nova-compute[75438]: Stderr: ''
Nov 09 02:58:15 user nova-compute[75438]: DEBUG oslo.privsep.daemon [-] privsep: reply[95317fbe-352b-4148-bb62-929ba0b97ea1]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=87049) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 02:58:15 user nova-compute[75438]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:58:15 user nova-compute[75438]: Exit code: 21
Nov 09 02:58:15 user nova-compute[75438]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:58:15 user nova-compute[75438]: Stderr: ''
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 09 02:58:15 user nova-compute[75438]: ERROR os_brick.initiator.connectors.iscsi 
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75438) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.base [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.024s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] <== disconnect_volume: return (25ms) None {{(pid=75438) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Disconnected iSCSI Volume {{(pid=75438) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 09 02:58:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Deleting instance files /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef_del
Nov 09 02:58:15 user nova-compute[75438]: INFO nova.virt.libvirt.driver [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Deletion of /opt/stack/data/nova/instances/978bc551-fbb6-4a45-b2b9-36ae31a8b5ef_del complete
Nov 09 02:58:15 user nova-compute[75438]: INFO nova.compute.manager [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 09 02:58:15 user nova-compute[75438]: DEBUG oslo.service.loopingcall [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75438) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.compute.manager [-] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Deallocating network for instance {{(pid=75438) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 09 02:58:15 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] deallocate_for_instance() {{(pid=75438) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG nova.network.neutron [-] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Updating instance_info_cache with network_info: [] {{(pid=75438) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 09 02:58:16 user nova-compute[75438]: INFO nova.compute.manager [-] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Took 0.81 seconds to deallocate network for instance.
Nov 09 02:58:16 user nova-compute[75438]: WARNING nova.volume.cinder [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Attachment c9dd0d29-4e5e-422d-aff4-fd83774e7587 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c9dd0d29-4e5e-422d-aff4-fd83774e7587. (HTTP 404) (Request-ID: req-d18c0315-e187-4039-b988-2ef1e22db8b0)
Nov 09 02:58:16 user nova-compute[75438]: INFO nova.compute.manager [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Took 0.02 seconds to detach 1 volumes for instance.
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:16 user nova-compute[75438]: INFO nova.scheduler.client.report [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Deleted allocations for instance 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-30c6477e-16b1-4ab5-b33e-903d9ef4bf5b tempest-VolumesSnapshotTestJSON-1997846373 tempest-VolumesSnapshotTestJSON-1997846373-project-member] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] Acquiring lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] Lock "978bc551-fbb6-4a45-b2b9-36ae31a8b5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] No waiting events found dispatching network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 09 02:58:16 user nova-compute[75438]: WARNING nova.compute.manager [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received unexpected event network-vif-plugged-60c98d21-9fb8-4ab6-a559-45ae0c214554 for instance with vm_state deleted and task_state None.
Nov 09 02:58:16 user nova-compute[75438]: DEBUG nova.compute.manager [req-8c5bb599-4dfb-47f9-be38-066b69be166e req-6c413d0c-b919-4cdf-8f52-e58d1674957e service nova] [instance: 978bc551-fbb6-4a45-b2b9-36ae31a8b5ef] Received event network-vif-deleted-60c98d21-9fb8-4ab6-a559-45ae0c214554 {{(pid=75438) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 09 02:58:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:58:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:58:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:43 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:58:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75438) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 09 02:58:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:58:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75438) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 09 02:58:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:58:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:59:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:05 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:05 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 02:59:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 02:59:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 02:59:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 02:59:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:11 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:59:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:59:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:59:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 02:59:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:59:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9134MB free_disk=24.79511260986328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing inventories for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating ProviderTree inventory for provider bfe02387-c3a8-4a94-8642-7f0b913b986c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Updating inventory in ProviderTree for provider bfe02387-c3a8-4a94-8642-7f0b913b986c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing aggregate associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, aggregates: None {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Refreshing trait associations for resource provider bfe02387-c3a8-4a94-8642-7f0b913b986c, traits: COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=75438) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 02:59:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 02:59:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:14 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:21 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:22 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 09 02:59:22 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] There are 0 instances to clean {{(pid=75438) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 09 02:59:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 02:59:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:33 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:38 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:38 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Cleaning up deleted instances with incomplete migration  {{(pid=75438) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 09 02:59:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 02:59:54 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_power_states {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 02:59:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:06 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:06 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:00:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:10 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:00:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:00:10 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:00:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:00:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:00:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:00:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:00:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:00:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:00:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9171MB free_disk=24.793907165527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:00:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:00:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:20 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:22 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:00:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:00:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:00:48 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:00:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:08 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:08 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:01:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:01:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:01:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:01:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:01:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=24.78470230102539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:01:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:01:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:17 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:22 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:23 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:34 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:01:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:01:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:45 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:01:50 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:01:55 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:00 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:05 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:09 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:09 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75438) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 09 03:02:10 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:12 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager.update_available_resource {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:02:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:02:12 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:02:12 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Auditing locally available compute resources for user (node: user) {{(pid=75438) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 09 03:02:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:02:13 user nova-compute[75438]: WARNING nova.virt.libvirt.driver [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 09 03:02:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Hypervisor/Node resource view: name=user free_ram=9170MB free_disk=24.783645629882812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75438) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75438) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG nova.compute.provider_tree [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed in ProviderTree for provider: bfe02387-c3a8-4a94-8642-7f0b913b986c {{(pid=75438) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG nova.scheduler.client.report [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Inventory has not changed for provider bfe02387-c3a8-4a94-8642-7f0b913b986c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75438) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG nova.compute.resource_tracker [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Compute_service record updated for user:user {{(pid=75438) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 09 03:02:13 user nova-compute[75438]: DEBUG oslo_concurrency.lockutils [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75438) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 09 03:02:15 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Starting heal instance info cache {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 09 03:02:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Rebuilding the list of instances to heal {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 09 03:02:15 user nova-compute[75438]: DEBUG nova.compute.manager [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Didn't find any instances for network info cache update. {{(pid=75438) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 09 03:02:15 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:16 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:18 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:19 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:20 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:24 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:25 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:25 user nova-compute[75438]: DEBUG oslo_service.periodic_task [None req-714c9649-a57d-48ba-a2ed-6d0c9932fb9b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75438) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 09 03:02:30 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 09 03:02:35 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 09 03:02:40 user nova-compute[75438]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75438) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}